Support Sagemaker as chat_models so it can be used for tool calling efficiently #7252
khanzzirfan
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Checked
Feature request
Sagemaker hosted models such as (Llama3.1, Mistral, ) all support tool calling. but the lang chain module sagemaker class, doesn't understand correctly the response from AI for tool calling because langchain->sagemaker is missing bind_tools functionality.
Although I created createAiToolAgent, createReActAgent, both are not helpful. doesn't work. I tested my theory with same llama3.1 model hosted on Ollama and ChatOllama works in tool calling. but sagemaker same model doesn't work .
Motivation
I spend a week in understanding langgrah and tool calling. but then realised Sagemaker hosted models are not working LangChain/Langraph. There should be a effiecient chat model for sagemaker to bind tools and interact with AI correctly.
This request is same as bedrock chatmodel request created here. #2744
Proposal (If applicable)
Please following the same pattern for bedrock chat model, there should be a similar sagemaker model too.
#2744
#2746
Beta Was this translation helpful? Give feedback.
All reactions