GPU 上跑显存爆掉，有没有办法embedding在cpu上，计算在GPU上呀
Open
- Dominant language
- C++
- Stars
- 2.9k
- Forks
- 553
- PR merge metrics
- No merged PRs in 30d
Description
我GPU的显存不够，有没有办法，整个embedding在cpu上，每个batch对应的embedding送到GPU上计算？
Contributor guide
No contributing guide indexed for this repository
Research direction
No files, tests, or entry points are identified in the issue. Start by locating the embedding and GPU computation paths, then determine whether batches can be transferred between CPU and GPU; done would mean supporting CPU-side embedding with each batch computed on the GPU without exhausting GPU memory.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100