ByteDance-Seed / ByteDance-Seed/Bagel
模型加载之后如何卸载
Open
- Dominant language
- Python
- Stars
- 6.2k
- Forks
- 545
- PR merge metrics
- No merged PRs in 30d
Description
bagel是个非常实用的模型，给我许多帮助。但是我现在有个服务加载了模型之后只有将服务进程退出模型才offload，我该如何手动使其offload不再占用gpu资源
Contributor guide
No contributing guide indexed for this repository
Research direction
No files, tests, or entry points are named. First inspect how the service loads the Bagel model and manages GPU memory; done would require a callable way to offload it without exiting the service and confirmation that GPU resources are released.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100