OpenBMB/BMInf

View on GitHub

Efficient Inference for Big Models

Stars: 585
Forks: 67
Open beginner issues: 0
Indexed issues: 16

Dominant language: Python
License: Apache-2.0
Last GitHub push: Jul 7, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

16 open issues indexed

assert m % 4 == 0 and n % 4 == 0 and k % 4 == 0 Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

OpenBMB/BMInf#70 · 1 comment · Opened Dec 28, 2024
为什么实际的显存占用总比我设置的多两个G? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

OpenBMB/BMInf#69 · Opened Jun 15, 2023
[BUG] GPU RTX4090 report errors Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

OpenBMB/BMInf#68 · Opened May 17, 2023
[FEATURE] Does BMInf support multiple nodes deployment? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

OpenBMB/BMInf#67 · Opened Mar 23, 2023
在使用CPM ANT+上使用BMinf时报错： Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

OpenBMB/BMInf#66 · Opened Mar 12, 2023
[FEATURE] Can the framework be combined with Faster Transformer? Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

OpenBMB/BMInf#65 · Opened Jan 31, 2023
BMInf支持 CPM-Bee/Live 模型吗? Open

question

Difficulty 5/5 Over a week Newbie friendliness 25/100

OpenBMB/BMInf#64 · 1 comment · Opened Jan 30, 2023
Examples of CPM-1/2 啥时候出呀，还有生成模型的代码 Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

OpenBMB/BMInf#59 · 2 comments · Opened Oct 9, 2022
CPM2自动问答任务怎么推理 Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

OpenBMB/BMInf#55 · 1 comment · Opened Jul 24, 2022
[BUG]RuntimeError: cublas error: CUBLAS_STATUS_NOT_SUPPORTED Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

OpenBMB/BMInf#52 · Opened Jun 10, 2022
请教CUPY/CUDA Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

OpenBMB/BMInf#51 · 1 comment · Opened May 21, 2022
[BUG]RuntimeError: Library cublasLt is not initialized Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

OpenBMB/BMInf#50 · Opened May 19, 2022
[BUG] RuntimeError: Unexpected model output: 26239 Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

OpenBMB/BMInf#49 · Opened May 16, 2022
[FEATURE] Question: why does CPM1.0 need 2 GPU cards while BMInf only need 1 GPU? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

OpenBMB/BMInf#44 · 4 comments · Opened Mar 10, 2022
[BUG] Error was raised when importing model in v1.0.x Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

OpenBMB/BMInf#40 · 12 comments · Opened Jan 17, 2022
AttributeError: type object 'cublasLt' has no attribute 'cublasLtHandle_t' Open

enhancement question

Difficulty 4/5 3-5 days Newbie friendliness 35/100

OpenBMB/BMInf#23 · 3 comments · Opened Oct 28, 2021

OpenBMB/BMInf

Get new issues in your inbox