Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation on the public CARLA Leaderboard #76

Open
626960883 opened this issue Jan 20, 2025 · 0 comments
Open

Evaluation on the public CARLA Leaderboard #76

626960883 opened this issue Jan 20, 2025 · 0 comments

Comments

@626960883
Copy link

hello! first thank you for releasing this codebase. I would like to ask how the evaluation indicators are calculated?

The article notes that route Completion is the percentage of the route completed by the autonomous agent. Infraction Score measures the number of infractions made along the route, with pedestrians, vehicles, road layouts, red lights, and etc. Driving Score is the main metric which is the product of Route Completion and Infraction Score.

Values based on Route Completion and Infraction Score are not equal to Driving Score. I am genuinely asking for advice as I have been studying this section recently and these are very important to my learning.

And is it possible to work out data such as Table2 in the text directly in the code?

Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant