Multi-GPU for nvidia
Offen
cuda
distributed-inference
ideas-to-explore
- Vorherrschende Sprache
- C
- Sterne
- 22.4k
- Forks
- 2.1k
- Ø Merge
- 2 T. 13 Std.
- Gemergte PRs (30 T.)
- 5
Beschreibung
Any interest in implementing multi-gpu CUDA setups? I have a 4x3090 + 128GB RAM I would love to use with these quants, since other quants are currently lacking in accuracy or just straight up don't exist.
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.