Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Delay in scores calculation #93

Open
kocmitom opened this issue Jul 29, 2022 · 1 comment
Open

Delay in scores calculation #93

kocmitom opened this issue Jul 29, 2022 · 1 comment
Labels
maybe? wmt23
Milestone
WMT23

Comments

@kocmitom
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
At WMT22 we had a problem with DoS, the potential problem was large testsets that needed to be scored. The solution could be calculating scores with a delay when the system has enough resources.

Describe the solution you'd like
Calculate scores with a delay. Possibly calculate only ChrF scores first.
@kocmitom kocmitom added the wmt23 label Apr 13, 2023
@cfedermann
Copy link
Collaborator

Related to #90.

@cfedermann cfedermann added this to the WMT23 milestone Jul 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
maybe? wmt23
Projects
None yet
Milestone
WMT23
Development

No branches or pull requests
2 participants
@cfedermann @kocmitom