-
Notifications
You must be signed in to change notification settings - Fork 5.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(eval): misc SWE-Bench improvement - use different resources for different instances #6313
Conversation
…different instances
90d027b
to
20ea911
Compare
Thanks Calvin! OpenHands can you help me address the comments? |
…resources for different instances
Here's a concise overview of the changes and their status: ✅ Successfully Resolved:
🔍 Current Status:
The changes effectively modernized the code and improved resource management without altering the core functionality. |
evaluation/benchmarks/swe_bench/resource/princeton-nlp__SWE-bench_Verified-test.json
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me, looking forward to not having so many restarts!
…different instances (All-Hands-AI#6313) Co-authored-by: openhands <[email protected]>
End-user friendly description of the problem this fixes or functionality that this introduces
Give a summary of what the PR does, explaining any non-trivial design decisions
Link of any specific issues this addresses
To run this PR locally, use the following command: