Hello, I was wondering if MixEval is still maintained? Will only update MixEval-X later？

[Lisi911]

No description provided.

[Psycoy]

Hi,

The MixEval focuses on text-only evaluation, while MixEval-X focuses on the multimodal evaluation.

So, yes, we will still maintain this repo, as they are separate repos.

[Lisi911]

Ok, I'd like to know how to submit our model in MixEval.

[Psycoy]

Ok, I'd like to know how to submit our model in MixEval.

Hi, you can refer to this issue for submitting to MixEval.

[Lisi911]

Ok, I get it.

[Lisi911]

Hi, I found that there are duplicate contents in the test set, will it affect the accuracy of the results? Do you think it is necessary to remove duplicate data?

[Psycoy]

Hi, I found that there are duplicate contents in the test set, will it affect the accuracy of the results? Do you think it is necessary to remove duplicate data?

Hi @Lisi911 ,

Please refer to this reply for duplication concerns