Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inquiry on Accessing and Updating CoIR Benchmark Rankings #10

Open
guanqun-yang opened this issue Nov 14, 2024 · 0 comments
Open

Inquiry on Accessing and Updating CoIR Benchmark Rankings #10

guanqun-yang opened this issue Nov 14, 2024 · 0 comments

Comments

@guanqun-yang
Copy link

guanqun-yang commented Nov 14, 2024

Dear Maintainers,

The README.md mentions that the CoIR benchmark is included as a subset of the MTEB benchmark. However, I couldn’t find a way to view model rankings specifically for CoIR on the MTEB leaderboard, as there doesn’t seem to be an option to filter by this subset.

If accessing CoIR rankings directly on MTEB isn’t feasible, I noticed that the published ranking list hasn’t been updated recently. Do you have any plans for an upcoming update?

Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant