v0.0.18

What's Changed

• fix: use llm from baseclass for metrics by @jjmachan in #189
• bugfix: context_precision by @shahules786 in #194
• Fix typos in Eval doc by @mmaysami in #198
• testset generation : Improvements by @shahules786 in #195
• feat: langchain documents support for TestsetGenerator by @jjmachan in #201
• docs: document loaders support by @shahules786 in #202
• feat: support for multiple n in llms by @jjmachan in #197
• feat: llamaIndex llm support by @jjmachan in #205
• Refactor testset_generator.py for newbies to understand easily by @Yongtae723 in #207
• fix: remove limit on pydantic 2.0 by @jjmachan in #209

New Contributors

• @mmaysami made their first contribution in #198

Full Changelog: v0.0.17...v0.0.18

v0.0.17

What's Changed

• Testset generation: add gaurdrails to chunk filtering by @shahules786 in #166
• Docs testset generation by @shahules786 in #165
• don't warn when context_precision is correctly called by @monstertruck in #168
• fixed chunk validation by @shahules786 in #169
• doc: init docs.ragas.io by @jjmachan in #170
• docs: Add references to ragas by @jjmachan in #171
• Docs: added contents by @shahules786 in #175
• Answer correctness metrics by @shahules786 in #161
• added imports to doc by @shahules786 in #178
• docs: added github and discord links by @jjmachan in #179
• Fix typos by @pitmonticone in #180
• docs: add refferences by @jjmachan in #177
• docs: support notebooks by @jjmachan in #182
• added emojis to docs by @shahules786 in #183
• Docs improvements by @shahules786 in #186
• testset generation: bug fixes by @shahules786 in #185

New Contributors

• @monstertruck made their first contribution in #168
• @pitmonticone made their first contribution in #180

Full Changelog: v0.0.16...v0.0.17

v0.0.16

What's Changed

• docs: azure openai quickstart by @jjmachan in #155
• fix: llamaIndex issues by @jjmachan in #156
• feat: changing context_relevancy to context_precision by @jjmachan in #157
• Test set generation paradigm by @shahules786 in #150
• Testset generation: documentation by @shahules786 in #158

Full Changelog: v0.0.15...v0.0.16

v0.0.15

What's Changed

• added contact info by @shahules786 in #142
• Add note about when ground truth labels are required by @tleyden in #146
• bug fix: embeddings -> embedding by @starrywheat in #134
• ZeroDivisionError in context_relevance by @DevanshuBrahmbhatt in #154

New Contributors

• @tleyden made their first contribution in #146
• @DevanshuBrahmbhatt made their first contribution in #154

Full Changelog: v0.0.14...v0.0.15

v0.0.14

What's Changed

• Update README.md by @emilesilvis in #139
• Fix remap_column_names by @yujonglee in #140

New Contributors

• @emilesilvis made their first contribution in #139
• @yujonglee made their first contribution in #140

Full Changelog: v0.0.13...v0.0.14

v0.0.13

General bug fixes and reliability improvements

What's Changed

• fix: spelling of context_relevancy by @jjmachan in #113
• update tutorial notebook by @Yongtae723 in #125
• Fix/column-map: fix bug in column_map argument of evaluation by @jjmachan in #121
• Update README with explanation of Ragas metrics by @Yongtae723 in #124
• Improve metrics by @shahules786 in #131
• add custom embeddings for answer relevance by @starrywheat in #123
• fix: remove dependency on protobuff by @jjmachan in #132
• fix: added support for azure LLM by @jjmachan in #133
• fix: update quickstart notebook by @jjmachan in #137
• fix: linting issues by @jjmachan in #138

New Contributors

• @Yongtae723 made their first contribution in #125
• @starrywheat made their first contribution in #123

Full Changelog: v0.0.12...v0.0.13

v0.0.12

What's Changed

• chore: added note about consultation by @jjmachan in #98
• llamaIndex: fix the bugs by @jjmachan in #100
• fix typos by @shahules786 in #102
• Limit context relevancy to 1 by @shahules786 in #105
• Improve context relevancy by @shahules786 in #112

Full Changelog: v0.0.11...v0.0.12

v0.0.11

What's Changed

• docs: correct docs for answer relevancy by @jjmachan in #86
• docs: notebook to showcase langsmith integration by @jjmachan in #84
• Bug fixes and improvements by @shahules786 in #89
• fix(spelling): relavancy -> relevancy by @mikeldking in #93
• feat: add support for langchain by @jjmachan in #94
• feat: column mapping to select columns by @jjmachan in #91
• Context Recall by @shahules786 in #96

New Contributors

• @mikeldking made their first contribution in #93

Full Changelog: v0.0.10...v0.0.11

v0.0.10

Main

• feat: llama_index integration by @jjmachan in #78
• New Answer relevancy metrics by @shahules786 in #77
• feat(context managers): added Context Managers to help with tracing by @jjmachan in #83

What's Changed

• feat: llama_index integration by @jjmachan in #78
• New Answer relevancy metrics by @shahules786 in #77
• added improved NLI prompt by @shahules786 in #81
• Update README.md by @shahules786 in #82
• feat(context managers): added Context Managers to help with tracing by @jjmachan in #83
• docs: notebook for langsmith integration by @jjmachan in #85

Full Changelog: v0.0.9...v0.0.10

v0.0.9

patch release for v0.0.8

What's Changed

• fix: validation was incorrect by @jjmachan in #75
• chore: added an e2e test in Makefile by @jjmachan in #76

Full Changelog: v0.0.8...v0.0.9