abetlen / abetlen/llama-cpp-python

Multi-arch support for pre-built cpu wheel

未关闭
#1,506 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
enhancement
主要语言
Python
星标
10.6k
派生
1.4k
PR 合并指标
PR 指标待抓取

描述

Currently pre-built cpu wheels are compiled for the lowest common denominator architecture. If we can compile multiple versions of the llama.cpp library with different accelerations compiled in each we can bundle all of them into the pre-built wheels and dynamically choose one based on the host cpu.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。