Add Self-Extend to the gemma.cpp
Abierto
Feature
good first issue
stat:awaiting response
- Lenguaje dominante
- C++
- Estrellas
- 7k
- Forks
- 660
- Merge medio
- 20 h 43 min
- PR fusionados (30 d)
- 33
Descripción
Hi team, I checked the locallama and found that gemma can work well with the Self-Extend method. It would be awesome if this technique could be added to the gemma.cpp.
References:
- [locallama](https://www.reddit.com/r/LocalLLaMA/comments/1b1q88w/selfextend_works_amazingly_well_with_gemma2bit/)
- [author thought](https://twitter.com/serendip410/status/1762586041549025700?s=20)
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.