Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CAI-315] - Evaluation using Ragas #1360

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

mdciri
Copy link
Collaborator

@mdciri mdciri commented Mar 3, 2025

List of Changes

  • evaluation using ragas framework
  • update chatbot.py to evaluate a trace and put the output scores on langfuse

Motivation and Context

monitoring the RAG with objective metrics

How Has This Been Tested?

locally

Screenshots (if appropriate):

Types of changes

  • Chore (nothing changes by a user perspective)
  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)

Checklist:

  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.

@mdciri mdciri requested a review from a team as a code owner March 3, 2025 15:06
Copy link

changeset-bot bot commented Mar 3, 2025

⚠️ No Changeset found

Latest commit: a16ef46

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

Copy link
Contributor

github-actions bot commented Mar 4, 2025

Jira Pull Request Link

This Pull Request refers to the following Jira issue CAI-315

Copy link
Contributor

github-actions bot commented Mar 4, 2025

Branch is not up to date with base branch

@mdciri it seems this Pull Request is not updated with base branch.
Please proceed with a merge or rebase to solve this.

Copy link
Contributor

github-actions bot commented Mar 4, 2025

This PR exceeds the recommended size of 800 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant