kvcache-ai / kvcache-ai/ktransformers
Intel Core Ultra NPU Support
Open
enhancement
- Dominant language
- Python
- Stars
- 19.5k
- Forks
- 1.6k
- Avg merge
- 19h 32m
- Merged PRs (30d)
- 27
Description
### Reminder
- [x] I have read the above rules and searched the existing issues.
### Description
目前消费级平台CPU没有AMX指令集,但是有集成NPU和核显,能否同时用CPU、NPU和核显计算Router Experts来达到比纯CPU运行更快的速度呢,具有可行性吗
### Pull Request
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.