You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This task is done when a common interface is implemented for llm clients.
And that the existing code for gemini and openi (from this PR) is refactored to use the common interface.
One of the issues is that different llm providers have different results sets and different methods. Eg. gemini-1.5-pro has a bunch of harm probabilities whereas openai does not.
Also the key/value names may differ slightly for some of the things that are supported across clients.
llm client class need:
a method to generate relevances
a method to parse the output into a set of str, str key/vals
a method to get credentials
additional items likely to be desireable:
handling of retry logic
handling of prompts (for now keep the prompt orthogonal to client)
The text was updated successfully, but these errors were encountered:
This task is done when a common interface is implemented for llm clients.
And that the existing code for gemini and openi (from this PR) is refactored to use the common interface.
One of the issues is that different llm providers have different results sets and different methods. Eg. gemini-1.5-pro has a bunch of harm probabilities whereas openai does not.
Also the key/value names may differ slightly for some of the things that are supported across clients.
llm client class need:
additional items likely to be desireable:
The text was updated successfully, but these errors were encountered: