elastic / elastic/roadmap

Native Anthropic Chat Completion Support

Open
#371 0 comments 0 reactions 1 assignee Claimed by @kapiljadhav-eis View on GitHub
Component: Elastic Inference Service product-area:search
Dominant language
No language data
Stars
6
Forks
1
PR merge metrics
No merged PRs in 30d

Description

Use Anthropic models natively in the inference service with full chat_completion support.

**What the feature is**
Native chat_completion task type support for Anthropic in the inference service, including streaming, tool handling, and system prompt formatting.

**Who bis this feature for**
Developers building conversational applications who want to use their own Anthropic API keys.

**Expected outcome**
Without native support, customers have to route Anthropic requests through external services, adding latency and infrastructure overhead. Native support cuts that out, so teams can stream responses and use advanced model features like tool handling and system prompts directly.

**Key user stories / use cases**
Streaming conversational responses from Anthropic models, using tool handling and system prompts natively, and simplifying infrastructure for teams already on Anthropic.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.