AI-Hypercomputer / AI-Hypercomputer/maxtext
Support LoRA training
Abierto
feature request
- Lenguaje dominante
- Python
- Estrellas
- 2.4k
- Forks
- 607
- Merge medio
- 2 d 19 h
- PR fusionados (30 d)
- 158
Descripción
Is there a plan to support PEFT methods like LoRA training in maxtext to support larger model fine-tuning / continue pretraining so that bigger models like LLaMA-3-70B can be trainined even with small amount of TPU/GPUs?
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.