(feat): Prompt engineering to remind o1 to generate a patch (#4807)

Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Xingyao Wang <[email protected]> Co-authored-by: mamoodi <[email protected]> Co-authored-by: tofarr <[email protected]> Co-authored-by: Robert Brennan <[email protected]>
All-Hands-AI · Nov 8, 2024 · a6810fa · a6810fa
1 parent fc05d8d
commit a6810fa
Showing 1 changed file with 8 additions and 0 deletions.
diff --git a/evaluation/swe_bench/run_infer.py b/evaluation/swe_bench/run_infer.py
@@ -91,6 +91,14 @@ def get_instruction(instance: pd.Series, metadata: EvalMetadata):
             "Your thinking should be thorough and so it's fine if it's very long.\n"
         )
 
+    instruction += (
+        '<IMPORTANT>\n'
+        '- You MUST generate only one action per turn!\n'
+        '- A patch is a set of changes to the source code of the codebase that you are given\n'
+        '- You MUST generate a patch that attempts to fix the issue described in the <pr_description>\n'
+        '</IMPORTANT>\n'
+    )
+
     if RUN_WITH_BROWSING:
         instruction += (
             '<IMPORTANT!>\n'