Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A command-line tool/script for making submissions #52

Open
snukky opened this issue Jun 21, 2021 · 0 comments
Open

A command-line tool/script for making submissions #52

snukky opened this issue Jun 21, 2021 · 0 comments
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@snukky
Copy link
Contributor

snukky commented Jun 21, 2021

Is your feature request related to a problem? Please describe.
We would like to have a tool/script for making a new submission from the command line to a specific OCELoT instance.

Describe the solution you'd like

  • A Python script that can be used to make a submission in the same way as it is done via https://ocelot.mteval.org/submit
  • The script could simply make a JSON request to some API exposed by OCELoT
  • The script should not be a Django management command so that it could be installable via setup.py
  • If the submission is successful, a message with BLEU and Chrf scores is displayed, otherwise there is an error message

Usage examples (it's only a draft and the script options/usage need a proper design):

# List available test sets from open competitions
./ocelot_submission.py https://ocelot.mteval.org

# Make a submission
./ocelot_submission.py https://ocelot.mteval.org --user team-name --token abcd1234
    --submission submission.xml --format xml --test-set 'newstest2020.en-de' 
@snukky snukky added the enhancement New feature or request label Jun 21, 2021
@snukky snukky changed the title A tool/script for make a submission A command-line tool/script for making submissions Jun 21, 2021
@snukky snukky self-assigned this Jul 8, 2021
@cfedermann cfedermann added this to the v1.0.0 milestone Jul 29, 2022
@cfedermann cfedermann removed the wmt23 label Jul 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants