abetlen / abetlen/llama-cpp-python

I want to know how to enable AMD GPU or enable hipBLAS/ROCm on Windows. I tried the official HIP (sdk) and set the relevant environment flags, but it seems to have no effect. BLAS is always at 0. Is there any solution for Windows? Plan?

Abierto
#978 2 comentarios 2 reacciones 0 asignados Ver en GitHub
question
Lenguaje dominante
Python
Estrellas
10.6k
Forks
1.4k
Métricas de merge de PR
Métricas de PR pendientes

Descripción

I want to know how to enable AMD GPU or enable hipBLAS/ROCm on Windows. I tried the official HIP (sdk) and set the relevant environment flags, but it seems to have no effect. BLAS is always at 0. Is there any solution for Windows? Plan?

AMD GPU: 6650xt
windows11

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.