Multi-GPU for nvidia
Abierto
cuda
distributed-inference
ideas-to-explore
- Lenguaje dominante
- C
- Estrellas
- 22.4k
- Forks
- 2.1k
- Merge medio
- 1 d 3 h
- PR fusionados (30 d)
- 4
Descripción
Any interest in implementing multi-gpu CUDA setups? I have a 4x3090 + 128GB RAM I would love to use with these quants, since other quants are currently lacking in accuracy or just straight up don't exist.
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.