Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to submit my model to the leaderboard? #10

Open
Waneila opened this issue Aug 19, 2024 · 9 comments
Open

How to submit my model to the leaderboard? #10

Waneila opened this issue Aug 19, 2024 · 9 comments

Comments

@Waneila
Copy link

Waneila commented Aug 19, 2024

No description provided.

@yuchenlin
Copy link
Collaborator

Hey Waneila,

If you have tested your models on the datasets, please share the model id on huggingface then we can probably help do the inference. If the model is too large or private, then you may create a PR to submit your results.

@Waneila
Copy link
Author

Waneila commented Sep 14, 2024

Hi yuchen,

Are there any restrictions for models on this ranking list? Are there any models that are not allowed to appear on the ranking?

@Nicat-dcw
Copy link

Hello yuchenlin. Can you evalute my model? Id: OnlyCheeini/greesychat-turbo

@yuchenlin
Copy link
Collaborator

Hi yuchen,

Are there any restrictions for models on this ranking list? Are there any models that are not allowed to appear on the ranking?

we have no particular restrictions

@yuchenlin
Copy link
Collaborator

Hello yuchenlin. Can you evalute my model? Id: OnlyCheeini/greesychat-turbo

sure will do

@Nicat-dcw
Copy link

Hello yuchenlin. Can you evalute my model? Id: OnlyCheeini/greesychat-turbo

sure will do

Can u notify me after you fully evaluate the model? And thanks 👍

yuchenlin pushed a commit that referenced this issue Sep 24, 2024
add script for command-r-plus
@tomtyiu
Copy link

tomtyiu commented Oct 10, 2024

Please test this model:
EpistemeAI/Fireball-Meta-Llama-3.1-8B-Instruct-Agent-0.003-128K-code'

System prompt: "You are an agent assistant. First, create an objective of the topic, use think carefully step by step, then split subtasks to accomplish the objective. Terminate when objective is reached"

@Nicat-dcw
Copy link

Hey @yuchenlin. Can you evaluated my model?

@tomtyiu
Copy link

tomtyiu commented Oct 19, 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants