Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

evaluation problem #13

Open
challow0 opened this issue Apr 24, 2023 · 8 comments
Open

evaluation problem #13

challow0 opened this issue Apr 24, 2023 · 8 comments

Comments

@challow0
Copy link

Dear author,
Thanks for your great work. When I tried to implement your result, I found the results are very odd. Can you help me to figure out why I got so high mAP values?

image

@SunYM2020
Copy link
Owner

Hi, this evaluation result is reasonable due to our updated data annotation, and data pre-processing process, which has led to an improvement in the accuracy of the open source code compared to the results reported in the paper.

@challow0
Copy link
Author

Hi, this evaluation result is reasonable due to our updated data annotation, and data pre-processing process, which has led to an improvement in the accuracy of the open source code compared to the results reported in the paper.

so this mAP value is correct?

@zhangshoulong
Copy link

这个map采用的是map50还是map50-95?

@zhangshoulong
Copy link

论文中提到map采用的是map50还是map50-95?
image
image

@neuhsm
Copy link

neuhsm commented May 4, 2023

论文中说到训练只有12个epoch,个人感觉应该没有收敛吧

@Markson-Young
Copy link

Dear author, Thanks for your great work. When I tried to implement your result, I found the results are very odd. Can you help me to figure out why I got so high mAP values?

image

请问你是使用未更新的xml标注文件进行测试的,还是使用coco格式的json文件转换得来的xml文件进行测试的。我训练UA-CMDet没能达到你那么高的精度:
image

@xiaofei624
Copy link

请问为什么你们的json标注中有负数,负数是什么意思

@leileilei2000
Copy link

亲爱的作者,感谢您的出色工作。当我尝试实现您的结果时,我发现结果非常奇怪。你能帮我弄清楚为什么我得到了这么高的 mAP 值吗?
image

请问你是使用未更新的xml标注文件进行测试的,还是使用coco格式的json文件转换得来的xml文件进行测试的。我训练UA-CMDet没能达到你那么高的精度: image

我也想知道这个问题,我的map只有70左右,我是用论文中的测试集test来得到的map

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants
@challow0 @zhangshoulong @Markson-Young @neuhsm @SunYM2020 @xiaofei624 @leileilei2000 and others