How to use Agentic AI multi-agent flow within this solution

[surendransuri]

I am already using this application. For some specific persona, I am planning to use Agentic AI for that. How to use Agentic AI.,multi-agent flow, orchestration of agents within this solution. Can I use existing frameworks like Autogen, Langgraph, CrewAI for implementation? Please help me on this. Please suggest me suitable method or approach for that

[dpayne-voss]

We've been using Azure functions to extend the capabilities of personas. Basically create a new extension which posts the user query to an Azure function, and couple the extension to your persona. The function can then implement whatever agent implementation you like and then provide a response, which the persona LLM will process and respond back to the user.

[olafwrieden]

Hi @surendransuri - Great question! Azure Chat was built as a foundation / base capability accelerator that can be extended by anyone. We don't have a pattern for agentic AI with this Azure Chat accelerator specifically, and our Azure AI Agent Service is probably the closest option to investigate. It is currently in public preview and not yet available in all regions via Azure AI Foundry.

When combined with an LLM (or SLM) of your choosing, and coupled with Semantic Kernel or the like, you get pretty powerful agent / orchestrator / worker capabilities that you can easily wrap a UI around or perhaps integrate within M365 Copilot or Teams to keep users in their productivity tools rather than breaking out to a web interface. Just some ideas... I think as an industry we are heading toward modular / domain-specific agents, rather than a single "monolithic" chatbot deployment with personas and prescriptive retrieval guidance.

At the moment there are no plans to bring this to Azure Chat as it fundamentally changes the retrieval architecture... but keep following the Pull Request section to stay updated with what the community and maintainers are working on. Alternatively, feel free to share your ideas here. 💡