AI-Hypercomputer / AI-Hypercomputer/JetStream
MOE with JetStream
Abierto
- Lenguaje dominante
- Python
- Estrellas
- 457
- Forks
- 67
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
Could someone explain or point to a doc that explains how MOE is implemented on Jetstream? Specifically, the all-to-all communications, static vs dynamic, sparse matmuls.
I would like to understand how XLA compiles MOE.
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.