MegEngine/InferLLM
View on GitHuba lightweight LLM model inference framework
- Stars
- 752
- Forks
- 94
- Open beginner issues
- 0
- Indexed issues
- 40
- Dominant language
- C++
- License
- Apache-2.0
- Last GitHub push
- Apr 7, 2024
- Latest indexed
- Sep 19, 2026
- Contributing guide
- No contributing guide
- Code of conduct
- No code of conduct
- Beginner labels
- No beginner labels indexed
- PR merge metrics
- No merged PRs in 30d
-
SG2042 服务器 make 出错 Open
Difficulty 4/5 3-5 days Newbie friendliness 30/100
-
无法加载模型bin或者guff模型 Open
Difficulty 4/5 3-5 days Newbie friendliness 25/100
-
有打算支持qwen吗 Open
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
Difficulty 4/5 3-5 days Newbie friendliness 20/100
-
这个有windows的部署教程吗 Open
Difficulty 3/5 1-2 days Newbie friendliness 35/100
-
Difficulty 4/5 3-5 days Newbie friendliness 28/100
-
移植问题 Open
Difficulty 5/5 Over a week Newbie friendliness 15/100
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
-
Difficulty 4/5 3-5 days Newbie friendliness 30/100
-
chatglm3有计划支持吗？ Open
Difficulty 5/5 Over a week Newbie friendliness 15/100
-
arm 平台输出乱码 Open
Difficulty 3/5 1-2 days Newbie friendliness 25/100
-
能否改为GPU辅助计算 Open
Difficulty 4/5 3-5 days Newbie friendliness 25/100
-
Difficulty 5/5 Over a week Newbie friendliness 15/100
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
-
Difficulty 5/5 Over a week Newbie friendliness 10/100
-
make error Open
Difficulty 4/5 3-5 days Newbie friendliness 25/100
-
Difficulty 4/5 3-5 days Newbie friendliness 28/100
-
Difficulty 3/5 1-2 days Newbie friendliness 25/100
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
-
希望可以封装openai兼容API Open
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
-
没有支持最新的llama.cpp的格式吗 Open
Difficulty 4/5 3-5 days Newbie friendliness 25/100
-
在线程数>1时，会占满cpu核心 Open
Difficulty 2/5 1-3 hours Newbie friendliness 35/100
-
make报错 Open
Difficulty 2/5 1-3 hours Newbie friendliness 45/100
-
Difficulty 4/5 3-5 days Newbie friendliness 20/100
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
-
isnan报错 Open
Difficulty 1/5 Under an hour Newbie friendliness 50/100
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
有实现思维树方式么 Open
Difficulty 5/5 Over a week Newbie friendliness 20/100
-
更新的太慢了，求加速 Open
Difficulty 5/5 Over a week Newbie friendliness 10/100
-
windows下面编译失败 Open
Difficulty 3/5 1-2 days Newbie friendliness 45/100
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
是否有计划优化GPU上的推理加速 Open
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
超参的理解是否是正确的？ Open
Difficulty 4/5 3-5 days Newbie friendliness 20/100
-
python API support Open
Difficulty 5/5 Over a week Newbie friendliness 15/100
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
Optimize Arm Kernel Open
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
Support more Model Open
Difficulty 5/5 Over a week Newbie friendliness 25/100