Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about multi-task test results #24

Open
congwei45 opened this issue Sep 21, 2024 · 2 comments
Open

Questions about multi-task test results #24

congwei45 opened this issue Sep 21, 2024 · 2 comments

Comments

@congwei45
Copy link

Hello, the success rates reported by your paper for 10 tasks are 28%, 76%, 64%, 60%, 56%, 24%, 16%, 92%, 20% and 12%. However, after evaluating, I get the success rates as 24%, 68%, 28%, 44%, 48%, 12%, 8%, 44%, 20% and 4%. Do you know the reasons? Thanks.

@GuanxingLu
Copy link
Owner

Please check #23 , thank you.

@congwei45
Copy link
Author

I get the average performance 30%, which is not in the range of 39.20-44.80.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants