Custom and pluggable Agent

[pieroit]

The Cat features a langchain ConversationalAgent which covers most easy use cases:

• chat with a memory context
• chat with tools use

At the moment this solution presents several limits:

• confusion between memory context and tools
• difficulty executing tools in sequence
• prompt is too long (small models have no chance)

Here is a roadmap to improve the Agent:
1 - have a more agile and resilient default agent (choosing among [these])(https://python.langchain.com/docs/modules/agents.html)
2 - have a pluggable agent - inserting a few hooks into CustomAgent, making it multiprompt and working on dictionaries
3 - having a hook to totally override the cat Agent in case a dev is brave enough (same as we do with LLM and embedders)

@nicola-corbellini @sirius-0 let's tackle this

[pieroit]

@sirius-0 please comment so I can assign the issue

[Pingdred]

@sirius-0 please comment so I can assign the issue

Here

[valentimarco]

@pieroit With the new agent structure, should we discuss a solution?

[pieroit]

@pieroit With the new agent structure, should we discuss a solution?

Agree, time to brainstorm this