Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incorrect response from "anthropic/claude-3.5-sonnet" model on OpenRouter API #96

Closed
ghominejad opened this issue Jun 22, 2024 · 0 comments

Comments

@ghominejad
Copy link

Describe the bug
When using the OpenAI format API request with the "anthropic/claude-3.5-sonnet" model via the endpoint https://openrouter.ai/api/v1/chat/completions, the response completion is not generating properly.

To Reproduce
Steps to reproduce the behavior:

  1. Make an API request to the endpoint https://openrouter.ai/api/v1/chat/completions using the OpenAI standard format.
  2. Use the model "anthropic/claude-3.5-sonnet".
  3. Example prompt:
    • System: You are Claude, a large language model trained by Anthropic. Carefully heed the user's instructions. Respond very concise.
    • User: loop from 1 to 100 in python
  4. Observe the response.

Expected behavior
The response should generate a concise and correct Python loop for iterating from 1 to 100.

Actual behavior
The response is incorrect and incomplete. Example response:

Here's a concise Python loop

for1, 101(i)

Additional context
This issue seems to be specific to the "anthropic/claude-3.5-sonnet" model when invoked using the OpenAI standard format. Other models or formats might not exhibit this behavior.


You can submit this report on the OpenRouter GitHub issues page.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant