Skip to content

Enable the recommendation bot to search for specific resource details #205

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 10 commits into
base: main
Choose a base branch
from

Conversation

mbertrand
Copy link
Member

@mbertrand mbertrand commented May 30, 2025

What are the relevant tickets?

Closes https://github.com/mitodl/hq/issues/6542

Description (What does it do?)

  • Adds the search_content_files tool to the list of tools available to the recommendation bot, and tweaks the system prompt to provide guidance on when to use it.
  • Adjusts the summarization node/function to work more appropriately (noticed some issues during testing, since the trigger to use it was hit more often due to the greater # of tokens used up by the content files tool).

How can this be tested?

Ask for course recommendations, then ask for some detailed info about 1 or more of the courses (how is it graded, are there any class projects, etc). Keep the conversation going for awhile to ensure the summarization is hit, responses seem reasonable, and no exceptions occur.

Additional Context

I needed to make some changes to the summarization code, because it assumed one tool call at a time, and after a couple rounds of summarization led to some tool output messages getting truncated from the list of messages sent to the summarization llm, leading to exceptions. As part of fixing that, I also simplified it a bit and forced it to create a summary only if the final message is a human message, to fully prevent any occurrences of human input -> tool call -> summarization -> response which often led to subpar responses compared to human input -> summarization -> tool call -> response.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant