Unauthorized (HTTP/1.1 401 Unauthorized) for Streaming Socket Android App #234

mhmohebbi · 2023-06-26T16:20:44Z

mhmohebbi
Jun 26, 2023

Which Deepgram product are you using?

Deepgram API

Details

I am trying to do live transcription in the context of an android app and below I have included a code snippet of my logic where I use deepgram.
I am trying to use the socket to do real time streaming here but I am not sure if there is a better way.
I currently get an HTTP/1.1 401 Unauthorized error and I am not sure what I am doing wrong. I am using the right token and there isn't any more clear docs on how to achieve this. Help would be appreciated

If you are making a request to the Deepgram API, what is the full Deepgram URL you are making a request to?

"wss://api.deepgram.com/v1/listen?model=nova&version=latest&punctuate=true&numerals=true&smart_format=true&interim_results=false&token=**********"

If you are making a request to the Deepgram API and have a request ID, please paste it below:

No response

If possible, please attach your code or paste it into the text box.

import android.Manifest
import android.content.Context
import android.content.pm.PackageManager
import android.media.AudioFormat
import android.media.AudioRecord
import android.media.MediaRecorder
import android.widget.Toast
import androidx.core.app.ActivityCompat
import com.neovisionaries.ws.client.WebSocket
import com.neovisionaries.ws.client.WebSocketAdapter
import com.neovisionaries.ws.client.WebSocketFactory
import com.neovisionaries.ws.client.WebSocketFrame
import java.nio.ByteBuffer
import java.nio.ByteOrder

class TranscriptionClient(private val context: Context) {
private var audioRecord: AudioRecord? = null
private val bufferSize: Int
private val buffer: ShortArray
private var webSocket: WebSocket? = null

init {
    val sampleRateInHz = 44100
    val channelConfig = AudioFormat.CHANNEL_IN_MONO
    val audioFormat = AudioFormat.ENCODING_PCM_16BIT

    bufferSize = AudioRecord.getMinBufferSize(sampleRateInHz, channelConfig, audioFormat)
    buffer = ShortArray(bufferSize)

    if (ActivityCompat.checkSelfPermission(context, Manifest.permission.RECORD_AUDIO) != PackageManager.PERMISSION_GRANTED) {
        Toast.makeText(context, "Permission denied, can't record audio", Toast.LENGTH_SHORT).show()
    }
    audioRecord = AudioRecord(MediaRecorder.AudioSource.MIC, sampleRateInHz, channelConfig, audioFormat, bufferSize)
}

fun startRecording() {
    println("Starting recording...")
    audioRecord?.startRecording()

    Thread {
        try {
            webSocket = WebSocketFactory().createSocket("wss://api.deepgram.com/v1/listen?model=nova&version=latest&punctuate=true&numerals=true&smart_format=true&interim_results=false&token=****************")
            webSocket?.addListener(object : WebSocketAdapter() {
                override fun onConnected(websocket: WebSocket?, headers: Map<String, List<String>>?) {
                    println("Connected to Deepgram WebSocket")
                    val byteBuffer = ByteBuffer.allocate(bufferSize * 2)
                    while (audioRecord?.recordingState == AudioRecord.RECORDSTATE_RECORDING) {
                        println("Sending audio data...")
                        val read = audioRecord?.read(buffer, 0, bufferSize) ?: 0
                        if (read > 0) {
                            byteBuffer.asShortBuffer().put(buffer, 0, read)
                            websocket?.sendBinary(byteBuffer.array())
                            byteBuffer.clear()
                        }
                    }
                }

                override fun onTextMessage(websocket: WebSocket?, text: String?) {
                    // Handle the received transcript
                    println("Received transcript: $text")
                    val transcript = parseTranscript(text)
                    // do something with the transcript...
                }

                override fun onDisconnected(websocket: WebSocket?, serverCloseFrame: WebSocketFrame?, clientCloseFrame: WebSocketFrame?, closedByServer: Boolean) {
                    // Handle WebSocket disconnection...
                }
            })

            webSocket?.connect()
        } catch (e: Exception) {
            e.printStackTrace()
        }
    }.start()
}

fun stopRecording() {
    println("Stopping recording...")
    audioRecord?.stop()
    audioRecord?.release()
    audioRecord = null

    // Close WebSocket when you're finished
    webSocket?.disconnect()
    webSocket = null
}

private fun parseTranscript(text: String?): String {
    // Parse the transcript from the text
    return text ?: ""
}

private fun ShortArray.toByteArray(): ByteArray {
    val byteBuffer = ByteBuffer.allocate(this.size * 2)
    byteBuffer.order(ByteOrder.LITTLE_ENDIAN)
    byteBuffer.asShortBuffer().put(this)
    return byteBuffer.array()
}

}

If possible, please attach an example audio file to reproduce the issue.

No response

Answered by nikolawhallon

Jul 11, 2023

I looked at those requests, and they seemed to process fine - if there is no transcript, it is either because there was no speech, or, more likely, because the audio format is not set correctly - are you specifying encoding=linear16&sample_rate=44100? And if so, are you sure this is correct? (Looking at the code, this is what it appears to be, but it is possible it isn't - the best way to validate that we suggest is here: https://github.com/deepgram/streaming-test-suite/tree/main#validate-your-audio).

View full answer

jjmaldonis · 2023-06-26T17:14:53Z

jjmaldonis
Jun 26, 2023
Maintainer

Hey @mhmohebbi this should be a quick fix. Rather than putting the token in the URL as a query parameter, the token should be set as a header in the websocket connection.

I don't know how to set headers for websocket tokens in Kotlin, but the key/value should be: {"Authorization": "Token ********""}. Make sure the word Token is included before your API key.

14 replies

mhmohebbi Jul 7, 2023
Author

Were you able to get an update for what could be causing the issue @nikolawhallon? Possibly anything detected from deepgram's end?

nikolawhallon Jul 7, 2023
Collaborator

For your request id 1247ee7a-ebe9-4fc9-b0fb-80cb2c418f1c we don't see any errors on our side, so we are adding some visibility into similar requests. If you still have the issue, can you share a couple more request ids? It would help us investigate more.

mhmohebbi Jul 10, 2023
Author

I apologize for the delay in getting these request ids for you @nikolawhallon, but yes we still have the same issue. The code is the same as what I previously showed you for what we are using. Here are a couple more examples (all of which have empty transcripts returned once I stopped):

2023-07-09 21:20:31.101 25636-25834 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:20:31.162 25636-25834 chatty                  com.shaphr.accessanotes              I  uid=10155(com.shaphr.accessanotes) ReadingThread identical 1 line
2023-07-09 21:20:31.223 25636-25834 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:20:31.232 25636-25636 System.out              com.shaphr.accessanotes              I  Stopping recording...
2023-07-09 21:20:31.271 25636-25834 System.out              com.shaphr.accessanotes              I  Received transcript: {"type":"Results","channel_index":[0,1],"duration":3.41,"start":0.0,"is_final":true,"speech_final":false,"channel":{"alternatives":[{"transcript":"","confidence":0.0,"words":[]}]},"metadata":{"request_id":"7b2e3bb6-ed17-4a86-af9c-5fd3d5abba54","model_info":{"name":"general-nova","version":"2023-05-31.0","arch":"nova"},"model_uuid":"85b5dbfd-bc1d-46b5-99d8-070d379a7f97"}}
2023-07-09 21:20:31.329 25636-25834 System.out              com.shaphr.accessanotes              I  Received Close Frame: 1000 Recording stopped
2023-07-09 21:20:31.333 25636-25834 System.out              com.shaphr.accessanotes              I  Disconnected from Deepgram WebSocket. Server Close Frame: 1000 Recording stopped

2023-07-09 21:22:10.470 25975-26035 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:22:10.832 25975-26035 chatty                  com.shaphr.accessanotes              I  uid=10155(com.shaphr.accessanotes) ReadingThread identical 6 lines
2023-07-09 21:22:10.893 25975-26035 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:22:10.954 25975-26035 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:22:11.015 25975-26035 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:22:11.321 25975-26035 chatty                  com.shaphr.accessanotes              I  uid=10155(com.shaphr.accessanotes) ReadingThread identical 5 lines
2023-07-09 21:22:11.382 25975-26035 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:22:11.445 25975-26035 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:22:11.504 25975-26035 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:22:11.565 25975-26035 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:22:11.627 25975-26035 chatty                  com.shaphr.accessanotes              I  uid=10155(com.shaphr.accessanotes) ReadingThread identical 1 line
2023-07-09 21:22:11.690 25975-26035 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:22:11.733 25975-25975 System.out              com.shaphr.accessanotes              I  Stopping recording...
2023-07-09 21:22:11.804 25975-26035 System.out              com.shaphr.accessanotes              I  Received transcript: {"type":"Results","channel_index":[0,1],"duration":3.02,"start":0.0,"is_final":true,"speech_final":false,"channel":{"alternatives":[{"transcript":"","confidence":0.0,"words":[]}]},"metadata":{"request_id":"6bc0f47f-a610-4d59-9607-109a9afa3aad","model_info":{"name":"general-nova","version":"2023-05-31.0","arch":"nova"},"model_uuid":"85b5dbfd-bc1d-46b5-99d8-070d379a7f97"}}
2023-07-09 21:22:11.806 25975-26035 System.out              com.shaphr.accessanotes              I  Received transcript: {"type":"Results","channel_index":[0,1],"duration":4.82,"start":3.02,"is_final":true,"speech_final":false,"channel":{"alternatives":[{"transcript":"","confidence":0.0,"words":[]}]},"metadata":{"request_id":"6bc0f47f-a610-4d59-9607-109a9afa3aad","model_info":{"name":"general-nova","version":"2023-05-31.0","arch":"nova"},"model_uuid":"85b5dbfd-bc1d-46b5-99d8-070d379a7f97"}}
2023-07-09 21:22:11.809 25975-26035 System.out              com.shaphr.accessanotes              I  Received Close Frame: 1000 Recording stopped
2023-07-09 21:22:11.814 25975-26035 System.out              com.shaphr.accessanotes              I  Disconnected from Deepgram WebSocket. Server Close Frame: 1000 Recording stopped

2023-07-09 21:17:08.325 25292-25353 chatty                  com.shaphr.accessanotes              I  uid=10155(com.shaphr.accessanotes) ReadingThread identical 6 lines
2023-07-09 21:17:08.382 25292-25353 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:17:08.443 25292-25353 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:17:08.564 25292-25353 chatty                  com.shaphr.accessanotes              I  uid=10155(com.shaphr.accessanotes) ReadingThread identical 2 lines
2023-07-09 21:17:08.626 25292-25353 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:17:08.710 25292-25353 System.out              com.shaphr.accessanotes              I  Sending audio data...
2023-07-09 21:17:08.721 25292-25292 System.out              com.shaphr.accessanotes              I  Stopping recording...
2023-07-09 21:17:08.833 25292-25353 System.out              com.shaphr.accessanotes              I  Received transcript: {"type":"Results","channel_index":[0,1],"duration":4.49,"start":0.0,"is_final":true,"speech_final":false,"channel":{"alternatives":[{"transcript":"","confidence":0.0,"words":[]}]},"metadata":{"request_id":"b365234a-f9d5-4d55-b7df-c46e3c9216cc","model_info":{"name":"general-nova","version":"2023-05-31.0","arch":"nova"},"model_uuid":"85b5dbfd-bc1d-46b5-99d8-070d379a7f97"}}
2023-07-09 21:17:08.834 25292-25353 System.out              com.shaphr.accessanotes              I  Received transcript: {"type":"Results","channel_index":[0,1],"duration":4.2800007,"start":4.49,"is_final":true,"speech_final":false,"channel":{"alternatives":[{"transcript":"","confidence":0.0,"words":[]}]},"metadata":{"request_id":"b365234a-f9d5-4d55-b7df-c46e3c9216cc","model_info":{"name":"general-nova","version":"2023-05-31.0","arch":"nova"},"model_uuid":"85b5dbfd-bc1d-46b5-99d8-070d379a7f97"}}
2023-07-09 21:17:08.841 25292-25353 System.out              com.shaphr.accessanotes              I  Received transcript: {"type":"Results","channel_index":[0,1],"duration":4.4300003,"start":8.77,"is_final":true,"speech_final":false,"channel":{"alternatives":[{"transcript":"","confidence":0.0,"words":[]}]},"metadata":{"request_id":"b365234a-f9d5-4d55-b7df-c46e3c9216cc","model_info":{"name":"general-nova","version":"2023-05-31.0","arch":"nova"},"model_uuid":"85b5dbfd-bc1d-46b5-99d8-070d379a7f97"}}
2023-07-09 21:17:08.845 25292-25353 System.out              com.shaphr.accessanotes              I  Received Close Frame: 1000 Recording stopped
2023-07-09 21:17:08.858 25292-25353 System.out              com.shaphr.accessanotes              I  Disconnected from Deepgram WebSocket. Server Close Frame: 1000 Recording stopped

nikolawhallon Jul 11, 2023
Collaborator

I looked at those requests, and they seemed to process fine - if there is no transcript, it is either because there was no speech, or, more likely, because the audio format is not set correctly - are you specifying encoding=linear16&sample_rate=44100? And if so, are you sure this is correct? (Looking at the code, this is what it appears to be, but it is possible it isn't - the best way to validate that we suggest is here: https://github.com/deepgram/streaming-test-suite/tree/main#validate-your-audio).

Answer selected by jpvajda

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Deepgram

Unauthorized (HTTP/1.1 401 Unauthorized) for Streaming Socket Android App #234

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 1 comment 14 replies

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

Select a reply

Deepgram

Unauthorized (HTTP/1.1 401 Unauthorized) for Streaming Socket Android App #234

mhmohebbi Jun 26, 2023

Which Deepgram product are you using?

Details

If you are making a request to the Deepgram API, what is the full Deepgram URL you are making a request to?

If you are making a request to the Deepgram API and have a request ID, please paste it below:

If possible, please attach your code or paste it into the text box.

If possible, please attach an example audio file to reproduce the issue.

Replies: 1 comment · 14 replies

jjmaldonis Jun 26, 2023 Maintainer

mhmohebbi Jul 7, 2023 Author

nikolawhallon Jul 7, 2023 Collaborator

mhmohebbi Jul 10, 2023 Author

nikolawhallon Jul 11, 2023 Collaborator

mhmohebbi
Jun 26, 2023

Replies: 1 comment 14 replies

jjmaldonis
Jun 26, 2023
Maintainer

mhmohebbi Jul 7, 2023
Author

nikolawhallon Jul 7, 2023
Collaborator

mhmohebbi Jul 10, 2023
Author

nikolawhallon Jul 11, 2023
Collaborator