Pipecat Android Client SDK: Transports

RTVI is an open standard for Real-Time Voice (and Video) Inference.

The following RTVI transports are available in this repository:

Daily WebRTC Transport

Add the following dependency to your build.gradle file:

implementation "ai.pipecat:daily-transport:0.3.2"

Instantiate from your code:

val callbacks = object : RTVIEventCallbacks() {

    override fun onBackendError(message: String) {
        Log.e(TAG, "Error from backend: $message")
    }

    // ...
}

val transport = DailyTransport.Factory(context)

val client = RTVIClient(transport, callbacks, options)

client.start().withCallback {
    // ...
}

client.start() (and other APIs) return a Future, which can give callbacks, or be awaited using Kotlin Coroutines (client.start().await()).

Gemini Live Websocket Transport

Add the following dependency to your build.gradle file:

implementation "ai.pipecat:gemini-live-websocket-transport:0.3.2"

Instantiate from your code:

val transport = GeminiLiveWebsocketTransport.Factory(context)

val options = RTVIClientOptions(
    params = RTVIClientParams(
        baseUrl = null,
        config = GeminiLiveWebsocketTransport.buildConfig(
            apiKey = "<your Gemini api key>",
            generationConfig = Value.Object(
                "speech_config" to Value.Object(
                    "voice_config" to Value.Object(
                        "prebuilt_voice_config" to Value.Object(
                            "voice_name" to Value.Str("Puck")
                        )
                    )
                )
            ),
            initialUserMessage = "How tall is the Eiffel Tower?"
        )
    )
)

val client = RTVIClient(transport, callbacks, options)

client.start().withCallback {
    // ...
}