google / google/gemma.cpp

Add Self-Extend to the gemma.cpp

Open
#60 19 comments 2 reactions 1 assignee Claimed by @KumarGitesh2024 View on GitHub
Feature good first issue stat:awaiting response
Dominant language
C++
Stars
7k
Forks
660
Avg merge
20h 43m
Merged PRs (30d)
33

Description

Hi team, I checked the locallama and found that gemma can work well with the Self-Extend method. It would be awesome if this technique could be added to the gemma.cpp.
References:
- [locallama](https://www.reddit.com/r/LocalLLaMA/comments/1b1q88w/selfextend_works_amazingly_well_with_gemma2bit/)
- [author thought](https://twitter.com/serendip410/status/1762586041549025700?s=20)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.