You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In both instances PASS_TO_PASS test lists contain a test incorrectly named [100%].
My understanding is that this was incorrectly captured into the dataset from the test execution logs.
Describe the bug
In both instances
PASS_TO_PASS
test lists contain a test incorrectly named[100%]
.My understanding is that this was incorrectly captured into the dataset from the test execution logs.
Steps/Code to Reproduce
Review column PASS_TO_PASS at:
https://huggingface.co/datasets/princeton-nlp/SWE-bench_Verified/viewer/default/test?q=pytest+58e6a09db49f34886ff13f3b7520dd0bcd7063cd
and
https://huggingface.co/datasets/princeton-nlp/SWE-bench_Verified/viewer/default/test?q=pytest+41d211c24a6781843b174379d6d6538f5c17adb9
Expected Results
Correct test names in the dataset
Actual Results
Test named
[100%]
System Information
No response
The text was updated successfully, but these errors were encountered: