Accuracy Scores on the +
Accuracy scores on the
DrawEduMath dataset.
@@ -383,7 +383,7 @@
Leaderboard on DrawEduMath
The leaderboard scores are based on the judgements using Mixtral 8x22B model.
+The leaderboard scores are based on similarity judgements of VLMs' answers to gold ones obtained using a Mixtral 8x22B model.
🚨 To submit your results to the leaderboard, please send to this email with your result json files.
@@ -425,9 +425,7 @@Overview
src="main_static/images/logos/assistments_a_logo.png" style="width:1.5em;vertical-align: middle" alt="Logo" />ASSISTments online learning platform, where students receive feedback from teachers on assigned work. - The problems that accompany each student response are drawn from three overlapping1 open educational - resources (OER): Eureka Math, Open Up - Resources, and Illustrative Math. + The problems that accompany each student response are drawn from three overlapping open educational resources (OER): Eureka Math, Open Up Resources, and Illustrative Math. @@ -451,8 +449,8 @@Overview
- You can download the dataset on Hugging Face Dataset. + In the future, we will release the dataset on Hugging Face, but in the meantime, fill out this Google form to express interest.
Overview
Examples
-Examples of teacher’s answers to a question asking about possible errors in students’ responses to math - problems. All three examples of students’ hand-drawn responses are for the same math problem asking students - to +
Here are examples of teachers' answers to a question asking about possible errors in students’ responses to math + problems. All three examples of students’ hand-drawn responses are for the same math problem asking students to draw and shade units on fraction strips to show 4 thirds, shown on the left.


Qualitative examples of the most common question types in our Examples of the most common question types in our
- DrawEduMath benchmark, categornized by type.
+ DrawEduMath benchmark, categorized by type.