AlexsJones / AlexsJones/llmfit
Request to add support for NPU and Hybrid models
未关闭
enhancement
Feature Request
Hardware Compatibility
- 主要语言
- Rust
- 星标
- 36.5k
- 派生
- 2.3k
- 平均合并
- 3 天 3 小时
- 30 天内合并 PR
- 90
描述
Hello
I have AMD Ryzen AI 7 350 processor in my laptop, which has inbuilt NPU. That's why it support Hybrid and NPU models also. Using the tools like [Lemonade server](https://github.com/lemonade-sdk/lemonade) and [FastFlowLM](https://github.com/FastFlowLM/FastFlowLM) I can run NPU and Hybrid LLM on my machine.
I like the concept of llmfit very much, but I found that currently llmfit does not have support for lemonade, FastFlowLM, NPU and Hybrid. Could you please add it in future updates.
贡献指南
评估
这个 Issue 还没有评估数据。