antirez / antirez/iris.c

[feature] Vulkan Backend

Aperta
#23 1 commento 1 reazione 0 assegnatari Vedi su GitHub
Lingua principale
C
Stelle
2k
Fork
151
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

I suggest adding a Vulkan compute backend for Windows/Linux GPU inference, as Vulkan has proven itself being a reliable (just works™), and often already installed GPU Compute API (almost no dependencies). It is also cross platform, and supports any GPU, even older ones.
It tends however to perform slightly worse compared to CUDA/ROCm/Metal on certain aspects, but I think that it is still worth implementing it, also considering how much of a speedup it gives compared to the native BLAS backend.
Llama.cpp has had a great success with it so far.

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.