[Bug]: missing role for choice 0 #1222

dilligaf911 · 2023-11-26T10:30:20Z

dilligaf911
Nov 26, 2023

Contact Details

What happened?

Hi! Thanks for your project!
I'm trying to use a project as a gui for a local proxy to openai. Our api is compatible with openai v1/chat/completions, but when I try to generate, gui return the error "Error: missing role for choice 0".
Moreover, during generation I see the correct answer of proxy, but when generation is finished I get an error.

Steps to Reproduce

Set OPENAI_REVERSE_PROXY=https://openai-proxy./public/v1/chat/completions
Run latest docker-compose image
authorize with email registration
ask to generate

What browsers are you seeing the problem on?

Chrome

Relevant log output

chat-meilisearch | [2023-11-26T10:08:11Z INFO  actix_web::middleware::logger] 172.19.0.4 "POST /indexes/messages/documents HTTP/1.1" 202 136 "-" "undici" 0.002903
chat-meilisearch | [2023-11-26T10:08:11Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 25 }
chat-meilisearch | [2023-11-26T10:08:11Z INFO  index_scheduler] A batch of tasks was successfully completed.
LibreChat      | {"level":"info","message":"[Login] [Login successful] [Username: <USER NAME>] [Request-IP: 10.234.129.178]","timestamp":"2023-11-26T10:09:49.292Z"}
chat-meilisearch | [2023-11-26T10:09:49Z INFO  actix_web::middleware::logger] 172.19.0.4 "GET /health HTTP/1.1" 200 22 "-" "undici" 0.000338
LibreChat      | ask log
LibreChat      | {
LibreChat      |   text: 'How to build helicopter',
LibreChat      |   conversationId: null,
LibreChat      |   endpointOption: {
LibreChat      |     endpoint: 'openAI',
LibreChat      |     chatGptLabel: null,
LibreChat      |     promptPrefix: null,
LibreChat      |     modelOptions: {
LibreChat      |       model: 'gpt-3.5-turbo-0613',
LibreChat      |       temperature: 1,
LibreChat      |       top_p: 1,
LibreChat      |       presence_penalty: 0,
LibreChat      |       frequency_penalty: 0
LibreChat      |     }
LibreChat      |   }
LibreChat      | }
LibreChat      | maxContextTokens 4095
LibreChat      | maxContextTokens 4095
LibreChat      | Loading history for conversation 9f50946e-1361-454e-adee-89d2b1cf53bf 00000000-0000-0000-0000-000000000000
LibreChat      | remainingContextTokens, this.maxContextTokens (1/2) 4084 4095
LibreChat      | remainingContextTokens, this.maxContextTokens (2/2) 4084 4095
LibreChat      | <-------------------------PAYLOAD/TOKEN COUNT MAP------------------------->
LibreChat      | Payload: [ { role: 'user', content: 'How to build helicopter' } ]
LibreChat      | Token Count Map: { '198fa90e-b440-45af-9e64-ae9e26e9a67d': 8 }
LibreChat      | Prompt Tokens 11 remainingContextTokens 4084 this.maxContextTokens 4095
LibreChat      | { '198fa90e-b440-45af-9e64-ae9e26e9a67d': 8, instructions: undefined }
LibreChat      | userMessage.tokenCount 8
LibreChat      | userMessage {
LibreChat      |   messageId: '198fa90e-b440-45af-9e64-ae9e26e9a67d',
LibreChat      |   parentMessageId: '00000000-0000-0000-0000-000000000000',
LibreChat      |   conversationId: '9f50946e-1361-454e-adee-89d2b1cf53bf',
LibreChat      |   sender: 'User',
LibreChat      |   text: 'How to build helicopter',
LibreChat      |   isCreatedByUser: true,
LibreChat      |   tokenCount: 8
LibreChat      | }
chat-meilisearch | [2023-11-26T10:10:05Z INFO  actix_web::middleware::logger] 172.19.0.4 "POST /indexes/messages/documents HTTP/1.1" 202 136 "-" "undici" 0.003237
chat-meilisearch | [2023-11-26T10:10:05Z INFO  actix_web::middleware::logger] 172.19.0.4 "GET /indexes/convos/documents/9f50946e-1361-454e-adee-89d2b1cf53bf HTTP/1.1" 404 189 "-" "undici" 0.000423
chat-meilisearch | [2023-11-26T10:10:05Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 26 }
LibreChat      | [Meilisearch] Convo not found and will index 9f50946e-1361-454e-adee-89d2b1cf53bf
LibreChat      | baseURL https://openai-proxy.<PROXY URL>/public/v1
LibreChat      | modelOptions {
LibreChat      |   model: 'gpt-3.5-turbo-0613',
LibreChat      |   temperature: 1,
LibreChat      |   top_p: 1,
LibreChat      |   presence_penalty: 0,
LibreChat      |   frequency_penalty: 0,
LibreChat      |   stop: [ '||>', '\nUser:', '<|diff_marker|>' ],
LibreChat      |   user: '65630dee349199df4bb0634f',
LibreChat      |   stream: true,
LibreChat      |   messages: [ { role: 'user', content: 'How to build helicopter' } ]
LibreChat      | }
chat-meilisearch | [2023-11-26T10:10:05Z INFO  index_scheduler] A batch of tasks was successfully completed.
chat-meilisearch | [2023-11-26T10:10:05Z INFO  actix_web::middleware::logger] 172.19.0.4 "POST /indexes/convos/documents HTTP/1.1" 202 134 "-" "undici" 0.004077
chat-meilisearch | [2023-11-26T10:10:05Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 11 }
chat-meilisearch | [2023-11-26T10:10:05Z INFO  index_scheduler] A batch of tasks was successfully completed.
LibreChat      | [OpenAIClient.chatCompletion][stream] Unhandled error type
LibreChat      | [OpenAIClient.chatCompletion][finalChatCompletion] Unhandled error type
LibreChat      | [OpenAIClient.chatCompletion] Unhandled error type
LibreChat      | Error: Error: missing role for choice 0
LibreChat      |     at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:778:15)
LibreChat      |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
LibreChat      |     at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:411:15)
LibreChat      |     at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:451:24)
LibreChat      |     at async /app/api/server/routes/ask/openAI.js:97:20
LibreChat      | Error: Error: missing role for choice 0
LibreChat      |     at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:778:15)
LibreChat      |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
LibreChat      |     at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:411:15)
LibreChat      |     at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:451:24)
LibreChat      |     at async /app/api/server/routes/ask/openAI.js:97:20
LibreChat      | TypeError: Cannot destructure property 'abortController' of 'abortControllers.get(...)' as it is undefined.
LibreChat      |     at abortMessage (/app/api/server/middleware/abortMiddleware.js:14:11)
LibreChat      |     at handleAbortError (/app/api/server/middleware/abortMiddleware.js:111:20)
LibreChat      |     at /app/api/server/routes/ask/openAI.js:141:5
LibreChat      |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
chat-meilisearch | [2023-11-26T10:10:16Z INFO  actix_web::middleware::logger] 172.19.0.4 "POST /indexes/messages/documents HTTP/1.1" 202 136 "-" "undici" 0.002529
chat-meilisearch | [2023-11-26T10:10:16Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 27 }

Also my proxy example output:

curl -X 'POST' \
  'https://<PROXY URL>/public/v1/chat/completions' \
  -H 'accept: application/json' \
  -H 'Authorization: Bearer eyJ---<TOKEN>---g' \
  -H 'Content-Type: application/json' \
  -d '{
  "model": "gpt-3.5-turbo",
  "messages": [{"role": "user", "content": "what is color of rainbow?"}]
}'


{
  "id": "chatcmpl-8P6OlBiw9ezDPMvAWwPvXLP4Lep2J",
  "object": "chat.completion",
  "created": 1700993487,
  "model": "gpt-3.5-turbo-0613",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "The colors of a rainbow are red, orange, yellow, green, blue, indigo, and violet.",
        "name": "",
        "function_call": null,
        "tool_calls": [],
        "tool_call_id": ""
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 13,
    "completion_tokens": 22,
    "total_tokens": 35
  },
  "system_fingerprint": ""
}

Screenshots

Code of Conduct

I agree to follow this project's Code of Conduct

Answered by danny-avila

Dec 14, 2023

You're welcome! It should be resolved now on the latest update if you want to try it out and let me know!

View full answer

danny-avila · 2023-11-26T13:29:26Z

danny-avila
Nov 26, 2023
Maintainer

It looks like you’re on an older version. Update to latest and try again (it doesn’t look like you’re on latest)

make sure you’re in the /c/ route and not /chat/ as it is now deprecated

0 replies

danny-avila · 2023-11-26T13:30:44Z

danny-avila
Nov 26, 2023
Maintainer

Update instructions are here: https://docs.librechat.ai/install/docker_compose_install.html#updating-librechat

2 replies

dilligaf911 Nov 26, 2023
Author

It seems the update according to the instructions did not help

Generation is successful. But when generation stops, I got same error

dilligaf911 Nov 26, 2023
Author

Also the same log:

chat-meilisearch | [2023-11-26T13:49:28Z INFO  actix_web::middleware::logger] 172.19.0.4 "GET /indexes/convos/documents/b27fab77-39e9-4b14-bf56-9254bb4aa0b1 HTTP/1.1" 404 189 "-" "undici" 0.001123
LibreChat      | [Meilisearch] Convo not found and will index b27fab77-39e9-4b14-bf56-9254bb4aa0b1
LibreChat      | baseURL https://openai-proxy......url......../public/v1
LibreChat      | modelOptions {
LibreChat      |   model: 'gpt-3.5-turbo',
LibreChat      |   temperature: 1,
LibreChat      |   top_p: 1,
LibreChat      |   presence_penalty: 0,
LibreChat      |   frequency_penalty: 0,
LibreChat      |   stop: [ '||>', '\nUser:', '<|diff_marker|>' ],
LibreChat      |   user: '65630dee349199df4bb0634f',
LibreChat      |   stream: true,
LibreChat      |   messages: [ { role: 'user', content: 'Hi! Write a small novel' } ]
LibreChat      | }
chat-meilisearch | [2023-11-26T13:49:28Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 32 }
chat-meilisearch | [2023-11-26T13:49:28Z INFO  actix_web::middleware::logger] 172.19.0.4 "POST /indexes/convos/documents HTTP/1.1" 202 134 "-" "undici" 0.004786
chat-meilisearch | [2023-11-26T13:49:28Z INFO  index_scheduler] A batch of tasks was successfully completed.
chat-meilisearch | [2023-11-26T13:49:28Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 14 }
chat-meilisearch | [2023-11-26T13:49:28Z INFO  index_scheduler] A batch of tasks was successfully completed.
LibreChat      | [OpenAIClient.chatCompletion][stream] Unhandled error type
LibreChat      | [OpenAIClient.chatCompletion][finalChatCompletion] Unhandled error type
LibreChat      | [OpenAIClient.chatCompletion] Unhandled error type
LibreChat      | Error: Error: missing role for choice 0
LibreChat      |     at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:813:15)
LibreChat      |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
LibreChat      |     at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:442:15)
LibreChat      |     at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:452:24)
LibreChat      |     at async /app/api/server/routes/ask/openAI.js:112:20
LibreChat      | Error: Error: missing role for choice 0
LibreChat      |     at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:813:15)
LibreChat      |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
LibreChat      |     at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:442:15)
LibreChat      |     at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:452:24)
LibreChat      |     at async /app/api/server/routes/ask/openAI.js:112:20
LibreChat      | TypeError: Cannot destructure property 'abortController' of 'abortControllers.get(...)' as it is undefined.
LibreChat      |     at abortMessage (/app/api/server/middleware/abortMiddleware.js:14:11)
LibreChat      |     at handleAbortError (/app/api/server/middleware/abortMiddleware.js:111:20)
LibreChat      |     at /app/api/server/routes/ask/openAI.js:148:5
LibreChat      |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
chat-meilisearch | [2023-11-26T13:49:44Z INFO  actix_web::middleware::logger] 172.19.0.4 "POST /indexes/messages/documents HTTP/1.1" 202 136 "-" "undici" 0.002169
chat-meilisearch | [2023-11-26T13:49:44Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 33 }
chat-meilisearch | [2023-11-26T13:49:44Z INFO  index_scheduler] A batch of tasks was successfully completed.

danny-avila · 2023-11-26T13:33:02Z

danny-avila
Nov 26, 2023
Maintainer

Also are you using another project for the reverse proxy setup? It would be helpful for testing to try it out if you could give me a link

1 reply

dilligaf911 Nov 26, 2023
Author

Thanks for your answer! Unfortunately proxy is not accessible from the internet

MchLrnX · 2023-12-14T03:58:18Z

MchLrnX
Dec 14, 2023

I ran into this today as well. Again I'm using a reverse proxy... gpt-4 on my end today. The response generated for the most part and then randomly threw the error and cut out.

LibreChat         | ask log
LibreChat         | {
LibreChat         |   text: 'Please tell me a story about a dog.',
LibreChat         |   conversationId: null,
LibreChat         |   endpointOption: {
LibreChat         |     endpoint: 'openAI',
LibreChat         |     chatGptLabel: null,
LibreChat         |     promptPrefix: null,
LibreChat         |     modelOptions: {
LibreChat         |       model: 'gpt-4',
LibreChat         |       temperature: 1,
LibreChat         |       top_p: 1,
LibreChat         |       presence_penalty: 0,
LibreChat         |       frequency_penalty: 0
LibreChat         |     }
LibreChat         |   }
LibreChat         | }
LibreChat         | { '7167bc32-b615-4599-9afe-24b0ba94e3f7': 13, instructions: undefined }
LibreChat         | userMessage.tokenCount 13
LibreChat         | userMessage {
LibreChat         |   messageId: '7167bc32-b615-4599-9afe-24b0ba94e3f7',
LibreChat         |   parentMessageId: '00000000-0000-0000-0000-000000000000',
LibreChat         |   conversationId: '28a57e55-bbec-4e0f-a784-ae2d6b7a63c3',
LibreChat         |   sender: 'User',
LibreChat         |   text: 'Please tell me a story about a dog.',
LibreChat         |   isCreatedByUser: true,
LibreChat         |   tokenCount: 13
LibreChat         | }
chat-meilisearch  | [2023-12-14T03:56:48Z INFO  actix_web::middleware::logger] 172.25.0.4 "POST /indexes/messages/documents HTTP/1.1" 202 136 "-" "undici" 0.003433
chat-meilisearch  | [2023-12-14T03:56:48Z INFO  actix_web::middleware::logger] 172.25.0.4 "GET /indexes/convos/documents/28a57e55-bbec-4e0f-a784-ae2d6b7a63c3 HTTP/1.1" 404 189 "-" "undici" 0.000210
chat-meilisearch  | [2023-12-14T03:56:48Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 39 }
chat-meilisearch  | [2023-12-14T03:56:48Z INFO  index_scheduler] A batch of tasks was successfully completed.
LibreChat         | [Meilisearch] Convo not found and will index 28a57e55-bbec-4e0f-a784-ae2d6b7a63c3
chat-meilisearch  | [2023-12-14T03:56:48Z INFO  actix_web::middleware::logger] 172.25.0.4 "POST /indexes/convos/documents HTTP/1.1" 202 133 "-" "undici" 0.002389
chat-meilisearch  | [2023-12-14T03:56:48Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 14 }
chat-meilisearch  | [2023-12-14T03:56:48Z INFO  index_scheduler] A batch of tasks was successfully completed.
LibreChat         | [OpenAIClient.chatCompletion][stream] Unhandled error type
LibreChat         | [OpenAIClient.chatCompletion][finalChatCompletion] Unhandled error type
LibreChat         | [OpenAIClient.chatCompletion] Unhandled error type
LibreChat         | Error: Error: missing role for choice 0
LibreChat         |     at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:826:15)
LibreChat         |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
LibreChat         |     at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:442:15)
LibreChat         |     at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:453:24)
LibreChat         |     at async /app/api/server/routes/ask/openAI.js:112:20
LibreChat         | Error: Error: missing role for choice 0
LibreChat         |     at OpenAIClient.chatCompletion (/app/api/app/clients/OpenAIClient.js:826:15)
LibreChat         |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
LibreChat         |     at async OpenAIClient.sendCompletion (/app/api/app/clients/OpenAIClient.js:442:15)
LibreChat         |     at async OpenAIClient.sendMessage (/app/api/app/clients/BaseClient.js:453:24)
LibreChat         |     at async /app/api/server/routes/ask/openAI.js:112:20
LibreChat         | TypeError: Cannot destructure property 'abortController' of 'abortControllers.get(...)' as it is undefined.
LibreChat         |     at abortMessage (/app/api/server/middleware/abortMiddleware.js:14:11)
LibreChat         |     at handleAbortError (/app/api/server/middleware/abortMiddleware.js:111:20)
LibreChat         |     at /app/api/server/routes/ask/openAI.js:148:5
LibreChat         |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
chat-meilisearch  | [2023-12-14T03:56:56Z INFO  actix_web::middleware::logger] 172.25.0.4 "POST /indexes/messages/documents HTTP/1.1" 202 136 "-" "undici" 0.004895
chat-meilisearch  | [2023-12-14T03:56:56Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 40 }
chat-meilisearch  | [2023-12-14T03:56:56Z INFO  index_scheduler] A batch of tasks was successfully completed.

5 replies

danny-avila Dec 14, 2023
Maintainer

@MchLrnX This indicates not a complete compatibility with openai SDK.

However, I will focus on handling this error so you can still use it as is.

MchLrnX Dec 14, 2023

You rock! Thank you!

danny-avila Dec 14, 2023
Maintainer

You're welcome! It should be resolved now on the latest update if you want to try it out and let me know!

Answer selected by danny-avila

MchLrnX Dec 14, 2023

Confirmed! I just tested a few prompts and it seems like it's fixed. Thank you!

danny-avila Dec 14, 2023
Maintainer

Sweet thank you for confirming!

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Bug]: missing role for choice 0 #1222

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 4 comments 8 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

[Bug]: missing role for choice 0 #1222

dilligaf911 Nov 26, 2023

Contact Details

What happened?

Steps to Reproduce

What browsers are you seeing the problem on?

Relevant log output

Screenshots

Code of Conduct

Replies: 4 comments · 8 replies

danny-avila Nov 26, 2023 Maintainer

danny-avila Nov 26, 2023 Maintainer

dilligaf911 Nov 26, 2023 Author

dilligaf911 Nov 26, 2023 Author

danny-avila Nov 26, 2023 Maintainer

dilligaf911 Nov 26, 2023 Author

MchLrnX Dec 14, 2023

danny-avila Dec 14, 2023 Maintainer

MchLrnX Dec 14, 2023

danny-avila Dec 14, 2023 Maintainer

MchLrnX Dec 14, 2023

danny-avila Dec 14, 2023 Maintainer

dilligaf911
Nov 26, 2023

Replies: 4 comments 8 replies

danny-avila
Nov 26, 2023
Maintainer

danny-avila
Nov 26, 2023
Maintainer

dilligaf911 Nov 26, 2023
Author

dilligaf911 Nov 26, 2023
Author

danny-avila
Nov 26, 2023
Maintainer

dilligaf911 Nov 26, 2023
Author

MchLrnX
Dec 14, 2023

danny-avila Dec 14, 2023
Maintainer

danny-avila Dec 14, 2023
Maintainer

danny-avila Dec 14, 2023
Maintainer