Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for minimax-regret curation #5

Open
MasterXiong opened this issue Apr 25, 2024 · 1 comment
Open

Support for minimax-regret curation #5

MasterXiong opened this issue Apr 25, 2024 · 1 comment

Comments

@MasterXiong
Copy link

Dear authors,

Thanks for deleloping this brilliant package to accelerate research in UED!

I'm trying to develop a minimax-regret curator, which seems to be not included in the current repo yet. E.g., for the maze task, the plan is to use algorithms like A* to compute the performance upper bound on each task, so that we can curate with the true regret on each task. I was wondering if you have some suggestions on what may be the best way to implement this? Is it sufficient to just add a new runner to support this new function? Thanks!

@minqi
Copy link
Contributor

minqi commented Aug 24, 2024

Thanks! One way to do this would be to extend ued_scores.py with your custom score function, then simply pass --ued_score='your_function_name' as part of train.py's command line args.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants