kvcache-ai / kvcache-ai/ktransformers

Intel Core Ultra NPU Support

Open
#1,701 2 comments 0 reactions 1 assignee Claimed by @KMSorSMS View on GitHub
enhancement
Dominant language
Python
Stars
19.5k
Forks
1.6k
Avg merge
19h 32m
Merged PRs (30d)
27

Description

### Reminder

- [x] I have read the above rules and searched the existing issues.

### Description

目前消费级平台CPU没有AMX指令集,但是有集成NPU和核显,能否同时用CPU、NPU和核显计算Router Experts来达到比纯CPU运行更快的速度呢,具有可行性吗

### Pull Request

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.