Possibility to connect to Azure Speech SDK Avatar

[tickx-cegeka]

Hi all,

I have been trying all day to connect a live chat avatar from the Azure AI speech studio / Speech SDK to this RAG audio solution, without success.

Sample code of that avatar can be found here. Trying the live chat avatar can be done in the Speech Studio.

However, the live chat avatar closes the microphone each time; the user has to click the microphone to talk again. In this RAG audio solution, you can keep talking and interrupt the openai realtime api.

Could anyone assist on how to merge these functionalities? It would be great to have an avatar, lip syncing, on top op this solution.