Add Self-Extend to the gemma.cpp
Aperta
Feature
good first issue
stat:awaiting response
- Lingua principale
- C++
- Stelle
- 7k
- Fork
- 660
- Merge medio
- 20h 43m
- PR unite (30g)
- 33
Descrizione
Hi team, I checked the locallama and found that gemma can work well with the Self-Extend method. It would be awesome if this technique could be added to the gemma.cpp.
References:
- [locallama](https://www.reddit.com/r/LocalLLaMA/comments/1b1q88w/selfextend_works_amazingly_well_with_gemma2bit/)
- [author thought](https://twitter.com/serendip410/status/1762586041549025700?s=20)
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.