feat(provider): add martian api #717
Conversation
|
Thanks for letting me contribute! so please feel free to provide any feedback. |
| @@ -1053,6 +1054,10 @@ export function constructConfigFromRequestHeaders( | |||
| openaiProject: requestHeaders[`x-${POWERED_BY}-openai-project`], | |||
| }; | |||
|
|
|||
| const martianConfig = { | |||
There was a problem hiding this comment.
Hey! I can see that this mapping was added in the PR. But its not used anywhere in the provider config. Can you please verify if this is required? We can remove it if its not used anywhere
| * @param {string} provider - The provider string. | ||
| * @returns {Array<string>} - An array of formatted stream chunks. | ||
| */ | ||
| export const MartianChatCompleteJSONToStreamResponseTransform: ( |
There was a problem hiding this comment.
JSONToStream transformer is only used for OpenAI provider. It is not required to write it for each provider because it assumes that the json that is passed to the function will always be OpenAI compliant.
Its already handled in responseHandler function. So I think it would be safe to remove it from here.
| const MartianConfig: ProviderConfigs = { | ||
| api: MartianAPIConfig, | ||
| chatComplete: MartianChatCompleteConfig, | ||
| responseTransforms: { |
There was a problem hiding this comment.
For OpenAI compliant providers, you can reuse the openai-base provider's function to avoid writing redundant code.
Please check inference-net provider integration as a reference on how to use the base provider:
gateway/src/providers/inference-net/index.ts
Lines 9 to 11 in 213273d
|
Hey! Thanks for the PR. I have added a few comments to start with. Please let me know if you have any doubts. |
|
Hey @lcrojano ! Please let us know if you have any doubts related to the comments. |
|
Moving this PR to draft state. Please update it once the comments are addressed. |
Title:
Implement Martian Router API Integration
Description:
Added configuration for the Martian Router API at withmartian.com/api/openai/v1
Updated provider settings to include Martian API integration.
Related Issues
closes #48