open-compass / open-compass/opencompass
在测评的时候显存总是有空闲，如何全部利用显存呢，单机 8*80G的 A800
Open
@Leymore is already working on this.
Since Apr 2, 2024.
- Dominant language
- Python
- Stars
- 7.5k
- Forks
- 869
- Avg merge
- 17h 52m
- Merged PRs (30d)
- 13
Description
Prerequisite
- I have searched Issues and Discussions but cannot get the expected help.
- The bug has not been fixed in the latest version.
Type
I'm evaluating with the officially supported tasks/models/datasets.
Environment
在用零一万物 34B进行 ceval测评的时候，显存只用了到了20%左右，调整哪个参数可以100%使用显存呢
Reproduces the problem - code/configuration sample
调整了batch_size也没有用
Reproduces the problem - command or script
调整了batch_size也没有用
Reproduces the problem - error message
调整了batch_size也没有用
Other information
调整了batch_size也没有用
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.