AlexsJones / AlexsJones/llmfit

Request to add support for NPU and Hybrid models

未关闭
#301 6 条评论 1 个 reaction 已指派 0 人 在 GitHub 查看
enhancement Feature Request Hardware Compatibility
主要语言
Rust
星标
36.5k
派生
2.3k
平均合并
3 天 3 小时
30 天内合并 PR
90

描述

Hello

I have AMD Ryzen AI 7 350 processor in my laptop, which has inbuilt NPU. That's why it support Hybrid and NPU models also. Using the tools like [Lemonade server](https://github.com/lemonade-sdk/lemonade) and [FastFlowLM](https://github.com/FastFlowLM/FastFlowLM) I can run NPU and Hybrid LLM on my machine.
I like the concept of llmfit very much, but I found that currently llmfit does not have support for lemonade, FastFlowLM, NPU and Hybrid. Could you please add it in future updates.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。