Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MeanAveragePrecision(average="micro") does not work when cats in dataset starts from 1 #2932

Open
sergiev opened this issue Feb 1, 2025 · 1 comment
Open

MeanAveragePrecision(average="micro") does not work when cats in dataset starts from 1 #2932

sergiev opened this issue Feb 1, 2025 · 1 comment
Labels
bug / fix Something isn't working help wanted Extra attention is needed

Comments

@sergiev
Copy link

sergiev commented Feb 1, 2025 •
edited
Loading

🐛 Bug

MeanAveragePrecision._get_coco_datasets() sets all labels to zero when self.average=="micro", but due to cocoeval.params.useCats==True you can have empty dts and gts in cocoeval.evaluate() if class 0 is not present in cocoeval.params.catIds.
Therefore no matter how bad or good the model's results actually are, all you've got in metric.compute() is just a bunch of -1s
@sergiev sergiev added bug / fix Something isn't working help wanted Extra attention is needed labels Feb 1, 2025
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 1, 2025

Hi! thanks for your contribution!, great first issue!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug / fix Something isn't working help wanted Extra attention is needed
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@sergiev