Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ENHANCEMENT] Add ability to create datasets from jsonl files #6453

Open
szeitlin opened this issue Feb 19, 2025 · 0 comments
Open

[ENHANCEMENT] Add ability to create datasets from jsonl files #6453

szeitlin opened this issue Feb 19, 2025 · 0 comments
Labels
c/datasets enhancement New feature or request triage issues that need triage

Comments

@szeitlin
Copy link

Is your feature request related to a problem? Please describe.
We have 'golden' datasets with input + expected output in json formats. It's extra work to have to reformat to CSV.
Would be great if we didn't have to do a lot of transformations to migrate from another eval tool.

Describe the solution you'd like
The ability to directly use files formatted with {'input': [], 'expected_output': []} as json, or if there are several rows like that, jsonl

Describe alternatives you've considered
It seems like we have to write some code to handle reformatting for the time being.

@szeitlin szeitlin added enhancement New feature or request triage issues that need triage labels Feb 19, 2025
@github-project-automation github-project-automation bot moved this to 📘 Todo in phoenix Feb 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
c/datasets enhancement New feature or request triage issues that need triage
Projects
Status: 📘 Todo
Development

No branches or pull requests

2 participants