Feature Request: Simplify Integration of Litellm with OpenAI-Compatible APIs
Open
C-feature-request
D-chatmodel-impl
- Dominant language
- Go
- Stars
- 13k
- Forks
- 1.1k
- Avg merge
- 4h 6m
- Merged PRs (30d)
- 41
Description
**Describe the solution you'd like**
Litellm is a widely used tool in the AI community that allows deploying a proxy and providing access via HTTP API. Additionally, the Litellm API is compatible with the OpenAI API protocol. It would be beneficial to simplify the process of creating a LitellmModel using the existing implementation available at:
https://github.com/cloudwego/eino-ext/tree/main/libs/acl/openai.
**Additional Context:**
litellm proxy doc: https://docs.litellm.ai/docs/simple_proxy
litellm api: https://litellm-api.up.railway.app/#/
Contributor guide
Assessment
This issue has not been assessed yet.