Skip to content

Commit

Permalink
fix(backend): removed correct_answer_key in settings_template for aut…
Browse files Browse the repository at this point in the history
…o_exact_match in evaluators resources
  • Loading branch information
bekossy committed Sep 19, 2024
1 parent dc4c978 commit bac7a51
Showing 1 changed file with 1 addition and 10 deletions.
11 changes: 1 addition & 10 deletions agenta-backend/agenta_backend/resources/evaluators/evaluators.py
Original file line number Diff line number Diff line change
Expand Up @@ -29,16 +29,7 @@
"name": "Exact Match",
"key": "auto_exact_match",
"direct_use": True,
"settings_template": {
"correct_answer_key": {
"label": "Expected Answer Column",
"default": "correct_answer",
"type": "string",
"advanced": True, # Tells the frontend that this setting is advanced and should be hidden by default
"ground_truth_key": True, # Tells the frontend that is the name of the column in the test set that should be shown as a ground truth to the user
"description": "The name of the column in the test data that contains the correct answer",
},
},
"settings_template": {},
"description": "Exact Match evaluator determines if the output exactly matches the specified correct answer, ensuring precise alignment with expected results.",
"oss": True,
"tags": ["functional"],
Expand Down

0 comments on commit bac7a51

Please sign in to comment.