AlexsJones / AlexsJones/llmfit
Request to add support for NPU and Hybrid models
オープン
enhancement
Feature Request
Hardware Compatibility
- 主要言語
- Rust
- スター
- 36.3k
- フォーク
- 2.3k
- 平均マージ
- 2日 18時間
- マージ済み PR（30日）
- 85
説明
Hello
I have AMD Ryzen AI 7 350 processor in my laptop, which has inbuilt NPU. That's why it support Hybrid and NPU models also. Using the tools like [Lemonade server](https://github.com/lemonade-sdk/lemonade) and [FastFlowLM](https://github.com/FastFlowLM/FastFlowLM) I can run NPU and Hybrid LLM on my machine.
I like the concept of llmfit very much, but I found that currently llmfit does not have support for lemonade, FastFlowLM, NPU and Hybrid. Could you please add it in future updates.
コントリビューションガイド
評価
この issue はまだ評価されていません。