Skip to content

Issues: explodinggradients/ragas

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

283 Open 714 Closed
283 Open 714 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Context Precision Calculation question Further information is requested
#1905 opened Feb 5, 2025 by ishachinniah-hds
StatementGeneratorPrompt's instruction mentions "statements", but these are not part of inputs anymore bug Something isn't working module-metrics this is part of metrics module
#1904 opened Feb 5, 2025 by diegodebrito
Generator Testset Portuguese Support module-testsetgen Module testset generation question Further information is requested
#1902 opened Feb 5, 2025 by jpfcabral
@shahules786
ModuleNotFoundError: No module named 'ragas.testset.evolutions' bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1897 opened Feb 2, 2025 by sahlebrahim
1
Discord invite links are invalid bug Something isn't working
#1896 opened Feb 1, 2025 by carlosgsouza
@jjmachan
3
does it support deepseek question Further information is requested
#1895 opened Feb 1, 2025 by landhu
2
Incorrect calculation at ToolCallAccuracy bug Something isn't working module-metrics this is part of metrics module
#1893 opened Feb 1, 2025 by licux
2
Response Relevancy: TypeError: object of type 'StringPromptValue' has no len() answered 🤖 The question has been answered. Will be closed automatically if no new comments bug Something isn't working module-metrics this is part of metrics module
#1892 opened Jan 30, 2025 by ishachinniah-hds
@jjmachan
9
what is the problem answered 🤖 The question has been answered. Will be closed automatically if no new comments question Further information is requested
#1890 opened Jan 30, 2025 by amin-kh96
1
Instability in answer relevance score bug Something isn't working question Further information is requested
#1889 opened Jan 30, 2025 by laughinghugs
@jjmachan
1
difference between retrieved contexts and reference contexts question Further information is requested
#1882 opened Jan 26, 2025 by Sara-Hossny
3
Traces in evaluation result are only saving the last prompt per trace name bug Something isn't working module-metrics this is part of metrics module
#1871 opened Jan 22, 2025 by VladTabakovCortea
1
@jjmachan
6
Error while executing the code example in the Migration Guide Documentation bug Something isn't working module-metrics this is part of metrics module
#1866 opened Jan 22, 2025 by GenAI-Rocky
1
How can I evaluate image retrieval? question Further information is requested
#1859 opened Jan 21, 2025 by simjak
2
How can I evaluate Ollama models such as Llama 3.3 using RAGAS? question Further information is requested
#1857 opened Jan 20, 2025 by HaniaMo
4
Prompt ${xx_prompt} failed to parse output: The output parser failed to parse the output including retries. bug Something isn't working question Further information is requested
#1856 opened Jan 20, 2025 by hsx1612727380
1
ValueError: cannot reshape array of size 1024 into shape (3, newaxis) bug Something isn't working question Further information is requested
#1854 opened Jan 18, 2025 by hsx1612727380
5
About Exception raised in Job[]: TimeoutError() bug Something isn't working module-metrics this is part of metrics module
#1850 opened Jan 16, 2025 by erliang-sf
Sequence[string] question Further information is requested
#1844 opened Jan 13, 2025 by amin-kh96
60
ModuleNotFoundError: No module named 'ragas.testset.generator' answered 🤖 The question has been answered. Will be closed automatically if no new comments bug Something isn't working module-testsetgen Module testset generation
#1842 opened Jan 13, 2025 by ParthP8399
6
AttributeError: 'NoneType' object has no attribute '_PENDING' bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#1840 opened Jan 13, 2025 by yidasanqian
[R-316] Feedback for Ragas App (app.ragas.io) enhancement New feature or request
#1822 opened Jan 8, 2025 by jjmachan
[Feautre Reuqest] [Bug] Async + RAGAS bug Something isn't working enhancement New feature or request fix-me
#1819 opened Jan 7, 2025 by logan-markewich
@jjmachan
4
why is answer_relevancy always nan？ module-metrics this is part of metrics module question Further information is requested
#1814 opened Jan 6, 2025 by LillyChen
5
Is there any plan to support reason in LLMMetrics and EvaluationResult? question Further information is requested
#1813 opened Jan 6, 2025 by parkerzf
4
ProTip! Exclude everything labeled bug with -label:bug.