You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
jamesbraza
changed the title
Retrying relevance score prompt if score was a float
Retrying relevance score prompt if score was a float or response isn't valid JSON
Dec 5, 2024
Our LLM response -->
Context
logic is a bit fragile:What currently happens is this blows up
Docs.aquery
.However, this should not be a critical failure because:
paper-qa
."We failed to parse valid JSON according to exception {exc!r}. Please respond with JSON."
"We failed to extract a valid score according to exception {exc!r}. Please provide an integer score in 1-10."
The text was updated successfully, but these errors were encountered: