LLM output regression from #857 building with Emscripten
Open
- Dominant language
- C++
- Stars
- 7k
- Forks
- 660
- Avg merge
- 20h 43m
- Merged PRs (30d)
- 33
Description
After #857, I now get gibberish from the llm output when using emscripten to build gemma.cpp.
To build you'll need [emsdk](https://github.com/emscripten-core/emsdk) and apply my patches from #833.
```bash
emcmake cmake -DCMAKE_POLICY_VERSION_MINIMUM=3.5 -B build-wasm
make -j -C build-wasm
node build-wasm/gemma.js --weights 270m-sfp-it.sbs --max_generated_tokens 100 --prompt "Why is the sky blue?"
```
Previous output: `Something about rayleigh scattering...`
New output: `áis собой Росії3atayavisフレックスateur choice...`
Contributor guide
Assessment
This issue has not been assessed yet.