[Feature] CPU synchronization Problem
Open
enhancement
- Dominant language
- Python
- Stars
- 421
- Forks
- 67
- PR merge metrics
- No merged PRs in 30d
Description
### Describe the feature
Some CPU synchronizations block the GPU kernel, leading to bubbles between GPU kernels. It should be optimized in the future.
1. item() in rotary embedding.
2. moe_loss construction.
### Will you implement it?
- [ ] I would like to implement this feature and create a PR!
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.