v0.0.22
What's Changed
- docs: comparing llms using ragas evaluations by @tinomaxthayil in #314
- convert context precision to json format by @shahules786 in #322
- fix: faithfulness.md by @kaiyikang in #328
- fix: structure faithfulness output by @shahules786 in #333
- fix: Column remap fix for Dataset evaluation by @tinomaxthayil in #331
- Fix OpenAIEmbeddings reference error in answer_relevancy by @ajinkyavbhandare in #329
- Fix: minor improvements across metrics by @shahules786 in #337
- fix wrong number by @Yongtae723 in #338
- fix: faithfulness for unrelated answering by @shahules786 in #340
- fix: load response as json by @shahules786 in #341
- docs: remove answer_relevancy from llm-docs by @tinomaxthayil in #343
- fix: bedrock llm error when evaluating rag qa
validate_api_key
by @arm-diaz in #350 - Added integration with Amazon API Gateway + bug fix in _answer_relevance.py by @brunopistone in #327
- feat: improve quality of answer correctness by @shahules786 in #339
- docs: add zeno visualization integration by @cabreraalex in #359
- fix(metrics): avoid getting none in context_recall by @yuukidach in #355
- fix: improved answer relevancy by @shahules786 in #346
- fix(types): fix pyright type issues with latest pyright version by @jjmachan in #366
- Retry for failed json loading by @shahules786 in #364
- fix: handle edge cases in prompt processing by @shahules786 in #374
New Contributors
- @kaiyikang made their first contribution in #328
- @ajinkyavbhandare made their first contribution in #329
- @brunopistone made their first contribution in #327
- @cabreraalex made their first contribution in #359
- @yuukidach made their first contribution in #355
Full Changelog: v0.0.21...v0.0.22