Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: support OpenAI compatible APIs in aws-genai plugin #316

Closed
vmahe35 opened this issue Dec 18, 2024 · 0 comments · Fixed by #317
Closed

feature: support OpenAI compatible APIs in aws-genai plugin #316

vmahe35 opened this issue Dec 18, 2024 · 0 comments · Fixed by #317
Labels
enhancement New feature or request

Comments

@vmahe35
Copy link
Contributor

vmahe35 commented Dec 18, 2024

🔖 Feature description

I suggest to add a new langgraph.openai.baseUrl parameter in the settings of the aws-genai plugin, that would look like this:

genai:
  agents:
    general: # This matches the URL in the frontend
      description: ...
      prompt: ...
      langgraph:
        openai:
          baseUrl: ${OPENAI_API_BASE_URL}
          apiKey: ${OPENAI_API_KEY}
          modelName: ${QUERY_MODEL_NAME}

🎤 Context

OpenAI APIs have become a de-facto standard for many AI frameworks and many people today also use Ollama to facilitate the management of models as a Service.
Ollama provides its own API but also has an OpenAI compatible interface.

Therefore, it would make sense to be able to configure another baseURL parameter for the endpoints than the default OpenAI endpoint (https://api.openai.com/v1).

✌️ Possible Implementation

I will submit a PullRequest for it (already developed and tested on my local dev env).

@vmahe35 vmahe35 added the enhancement New feature or request label Dec 18, 2024
vmahe35 pushed a commit to vmahe35/backstage-plugins-for-aws that referenced this issue Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant