cloudwego / cloudwego/eino

Feature Request: Simplify Integration of Litellm with OpenAI-Compatible APIs

Open
#43 0 comments 3 reactions 0 assignees View on GitHub
C-feature-request D-chatmodel-impl
Dominant language
Go
Stars
13k
Forks
1.1k
Avg merge
4h 6m
Merged PRs (30d)
41

Description

**Describe the solution you'd like**

Litellm is a widely used tool in the AI community that allows deploying a proxy and providing access via HTTP API. Additionally, the Litellm API is compatible with the OpenAI API protocol. It would be beneficial to simplify the process of creating a LitellmModel using the existing implementation available at:
https://github.com/cloudwego/eino-ext/tree/main/libs/acl/openai.

**Additional Context:**
litellm proxy doc: https://docs.litellm.ai/docs/simple_proxy
litellm api: https://litellm-api.up.railway.app/#/

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.