Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear the quota without removing the score from the results table #1773

Open
AlexeyBryncev opened this issue Mar 6, 2025 · 2 comments
Open

Comments

@AlexeyBryncev
Copy link

My team is running the 4973 competition as part of NTIRE 2025. The theme of the competition is related to video processing and implies that participants need to upload quite heavy video submissions. Our competition is organized in 4 phases, and we compile a leaderboard based on the results of each phase.

We have encountered the fact that due to the specifics of the competition, by the 3rd phase some participants have already run out of quota and can no longer send submissions. In this case, deleting their submits from an earlier phase will result in the loss of the result of their participation in this phase in the results table, which we cannot allow.

We would like to know if there is any way to clear their quota, leaving only their results from previous phases of the competition. Or whether it is possible to quickly (within the next 24 hours) add the necessary functionality to the platform. It would be very nice if you could help to solve this problem as soon as possible.

@AlexeyBryncev
Copy link
Author

Also for the future there is a question about whether it is possible to use organizers capacity to store participants submissions? In other words, if organizers will use local compute workers (https://github.com/codalab/codabench/wiki/Compute-Worker-Management---Setup), is it possible to use storage of these workers for participants submissions as well, so that they don't have a quota problem?

@ihsaan-ullah
Copy link
Collaborator

ihsaan-ullah commented Mar 10, 2025

A quick workaround would be to download the leaderboard before clearing the submissions so that you have a copy of the leaderboard.

There are no plans yet for a local/outside storage for submissions but the idea seems interesting.

EDIT: For information

If you have enough resources, you can deploy your own Codabench then you can control the quota allocation and the storage.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants