google / google/gemma.cpp

Abort / Assertion-error when loading gemma-3/gemmaCpp/3.0-1b-it-sfp

Abierto
#726 2 comentarios 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
C++
Estrellas
7k
Forks
660
Merge medio
20 h 43 min
PR fusionados (30 d)
33

Descripción

With current `dev` (commit 684a0444e9bb6ddba53c361d87def055235ca387 (HEAD -> dev, origin/dev)) following the `Readme.md` using the bazel-based path:

### Gemma2: Looks ok
https://www.kaggle.com/models/google/gemma-2/gemmaCpp/2.0-9b-it-sfp

bazel-bin/gemma --tokenizer tokenizer.spm --weights 2.0-2b-it-sfp.sbs --prompt_file /mnt/c/Users/XXX/Desktop/llm_prompt.txt

1180131840 blob bytes (36.83%) of bf16
2024275968 blob bytes (63.17%) of sfp
normalizer.cc(52) LOG(INFO) precompiled_charsmap is empty. use identity normalization.

[ Reading prompt ] ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

[ Timing info ] Prefill: 24927 ms for 3829 prompt tokens (153.60 tokens / sec); Time to first token: 25039 ms
...

### Gemma3: Assertion error
https://www.kaggle.com/models/google/gemma-3/gemmaCpp/3.0-1b-it-sfp

bazel-bin/gemma --tokenizer tokenizer.spm.GEMMA3 --weights 1b-it-sfp.sbs.GEMMA3 --prompt_file /mnt/c/Users/XXX/Desktop/llm_prompt.txt

604248320 blob bytes (46.41%) of bf16
697761792 blob bytes (53.59%) of sfp
normalizer.cc(52) LOG(INFO) precompiled_charsmap is empty. use identity normalization.
Abort at weights.cc:454: Assert offset == range.End():

Guía de contribución

Abrir la guía de contribución

Línea de trabajo

Reproduce el comando de Gemma3 del issue utilizando la ruta basada en bazel descrita en Readme.md; después, inspecciona la aserción en weights.cc:454 y compárala con la carga exitosa de Gemma2. Se considera completado cuando los pesos de Gemma3 se carguen sin la aserción de offset y el comando de prompt indicado continúe normalmente.

Escrito por el modelo de indexación a partir del texto del issue.

Evaluación

Stack tecnológico
cpp
Área
machine-learning
Tipo de issue
Error
Dificultad
3/5
Tiempo estimado
1-2 días
Estado de actividad
Estancado
Claridad
Bastante claro
Aptitud para principiantes
35/100

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.