Distributed SSD streaming
Abierto
- Lenguaje dominante
- C
- Estrellas
- 22.4k
- Forks
- 2.1k
- Merge medio
- 1 d 3 h
- PR fusionados (30 d)
- 4
Descripción
Looking at the SSD streaming feature, I was wondering whether you've experimented with streaming weights from multiple disks. Most Macs have many independent Thunderbolt 4/5 buses, so we could attach multiple external enclosures with NVME drives. If the weights were copied onto each drive, including the internal one, we could stream a different portion of the weights from each drive (a bit like RAID 1). This could a be "cheap" way to increase the SSD bandwidth in random reads, and maybe make these cache miss less expensive?
I am not really familiar with ds4's codebase, so this could be irrelevant, just some food for thoughts.
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.