MegEngine / MegEngine/InferLLM

希望可以封装openai兼容API

Open
#47 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
752
Forks
94
PR merge metrics
No merged PRs in 30d

Description

现有系统仅有Cli方式,应用不便。封装成api就可以供各类应用调用了。
chatglm项目中就有api。
希望可以加入。感谢。

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the existing CLI entry point and the surrounding InferLLM interfaces, then compare the requested behavior with the ChatGLM API reference mentioned in the issue. Define the API surface, compatibility requirements, and completion criteria before implementation; the issue names no files or tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
api, backend-api-design
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.