abetlen / abetlen/llama-cpp-python

Support sm100 and sm120 in CUDA pre‑built wheels

Open
#2,341 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
10.6k
Forks
1.4k
PR merge metrics
PR metrics pending

Description

```
CUDA : ARCHS = 750,800,860,890,900
```
The current pre‑built CUDA wheels only support up to sm90. Please extend the build to include sm100 and sm120 so users with newer GPUs (B200 and RTX 50 series) can install directly via pip without compiling from source. Thank you!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.