Bug fix to evaluation check

datakind · Jul 10, 2024 · 7043e1c · 7043e1c
1 parent e77956d
commit 7043e1c
Showing 1 changed file with 5 additions and 0 deletions.
diff --git a/flows/chainlit-ui-evaluation/groundedness_score.jinja2 b/flows/chainlit-ui-evaluation/groundedness_score.jinja2
@@ -27,6 +27,11 @@ Independent Examples:
 ## Example Task #4 Output:
 1
 
+Key points:
+
+- Focus on facts, not on the language used to present the facts
+- If the ANSWER presents a fact, and the CONTEXT presents the same fact, groundedness is 5
+
 Reminder: The return values for each task should be correctly formatted as an integer between 1 and 5. Do not repeat the context.
 
 ## Actual Task Input: