You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
I am not sure how it happens, but there can be different names in the Ocelot leaderboard and different name then on files we use for further evaluation. Could these two team names be unified?
The text was updated successfully, but these errors were encountered:
On Thu, Apr 13, 2023, 3:13 PM kocmitom ***@***.***> wrote:
*Is your feature request related to a problem? Please describe.*
I am not sure how it happens, but there can be different names in the
Ocelot leaderboard and different name then on files we use for further
evaluation. Could these two team names be unified?
—
Reply to this email directly, view it on GitHub
<#108>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AACSH2DQM4KFL3JBXRTKHUTXA73V7ANCNFSM6AAAAAAW5CE7G4>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>
But I am not sure if it is the source of the issue. Usually, those have been 1:1 but some teams decided to name their team differently (as in the exampel) than their systems and then it was detective work to figure out which system is whose (without access to Ocelot).
The easiest would be to drop redundant names and just keep team name = system name. What you think?
There is some logic in _team_name() to generate the name based on the publication_name but fall back to using the actual file's original_name when the former is missing/fails. This may explain the differences you have observed.
That being said, at export time, the file names we use for the results archive should match the expected publication_name value. Let's look into this once we have a first couple of submissions, so that we can define exactly what we have to fix/change.
Is your feature request related to a problem? Please describe.
I am not sure how it happens, but there can be different names in the Ocelot leaderboard and different name then on files we use for further evaluation. Could these two team names be unified?
The text was updated successfully, but these errors were encountered: