LLM output regression from #857 building with Emscripten
Offen
- Vorherrschende Sprache
- C++
- Sterne
- 7k
- Forks
- 660
- Ø Merge
- 20 Std. 43 Min.
- Gemergte PRs (30 T.)
- 33
Beschreibung
After #857, I now get gibberish from the llm output when using emscripten to build gemma.cpp.
To build you'll need [emsdk](https://github.com/emscripten-core/emsdk) and apply my patches from #833.
```bash
emcmake cmake -DCMAKE_POLICY_VERSION_MINIMUM=3.5 -B build-wasm
make -j -C build-wasm
node build-wasm/gemma.js --weights 270m-sfp-it.sbs --max_generated_tokens 100 --prompt "Why is the sky blue?"
```
Previous output: `Something about rayleigh scattering...`
New output: `áis собой Росії3atayavisフレックスateur choice...`
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.