Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Seeking suggestions for evaluating the Ego4D dataset #5

Open
sdqdlgj opened this issue Oct 18, 2024 · 0 comments
Open

Seeking suggestions for evaluating the Ego4D dataset #5

sdqdlgj opened this issue Oct 18, 2024 · 0 comments

Comments

@sdqdlgj
Copy link

sdqdlgj commented Oct 18, 2024

Hi Xizi,

Thanks for open-sourcing the LoCoNet code, which demonstrates excellent performance.

May I inquire about how to evaluate the mAP performance of the Ego4D dataset?
The official Ego4D repository provides mAP evaluation code (https://github.com/EGO4D/audio-visual/tree/main/active-speaker-detection/active_speaker), but I have a few questions:

  1. The official Ego4D repository presents a complex testing process, and the format of some files, such as val.txt, v.txt and etc., are unclear. Do you have any usage suggestions for the Ego4D evaluation code?
  2. I would like to know whether the mAP metric for Ego4D is calculated in the same way as the mAP metric for the AVA dataset?

Thank you in advance!

Best,
Guanjun

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant