-
Notifications
You must be signed in to change notification settings - Fork 1
Changelog
pipinstallyp edited this page Jul 29, 2024
·
1 revision
New Features:
-
Chat History JSON
- Saving all chat interactions with echo into
chat_history.json
.
- Saving all chat interactions with echo into
-
Message Summarization:
- Using Mixtral-8x7b-32768 model to summarize messages every last 10 minutes. This is going to handle echo's short-term memory loss or limited context handling.
TODOs:
-
Rate Limits Observation:
- Monitor how rate limits impact the flow and quality of conversations. Check rate limit error codes, and how it impacts conversations in real time. How often does echo stop responding? Is it due to rate limits or some other reason. Only way to find out is to let echo run for a while and see how things play out.
-
Prompt Effectiveness:
- Evaluate how different prompts influence the conversation. Analyze the impact on the group's interaction with Echo.
-
Vector Database??
- Maybe? There doesn't feel a need for it now. If the conversations drag out long, and I'd like Echo to see previous conversations then a vector database will be introduced too.