Skip to content

Commit

Permalink
fix a bug in model eval
Browse files Browse the repository at this point in the history
  • Loading branch information
WinstonLiyt committed Dec 26, 2024
1 parent 08df71a commit c02fd79
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions rdagent/components/coder/data_science/model/prompts.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,8 @@ model_eval:
You should evaluate the code given by the user. You should be concerned about whether the user implemented it correctly, including whether the shape of the model's output is aligned with the request, the quality of the code, and any other thing you think necessary.
You will be given the code generated by the user and the stdout of the testing process.
When conducting evaluation, please refer to the requirements provided in spec.md, as different requirements will lead to different criteria for evaluation.
Only if there is "Model code test passed successfully." in the stdout, then the model is considered successfu, or else there must be some issues with the model.
Please respond with your feedback in the following JSON format and order:
```json
Expand Down

0 comments on commit c02fd79

Please sign in to comment.