Open
Description
SageMaker Endpoints are currently only handled as an LLM. This introduces additional steps and a lot of complexity to integrate them within an agentic setup on LangGraph. SageMaker Endpoints should be accessible like Bedrock through a ChatModel as such:
llm = ChatBedrock(
model_id="anthropic.claude-3-sonnet-20240229-v1:0",
region_name="us-east-1"
)
To validate functionality, ChatSageMakerEndpoint should be a stand-in replacement for ChatBedrock in a LangGraph StateGraph
.
Tasks
- ChatSageMakerEndpoint implementation, provides basic invoke feature
- Streaming support
- Function calling with tools support
Metadata
Metadata
Assignees
Labels
No labels