microsoft / microsoft/onnxruntime-inference-examples
Chat with onnxruntime-web fails when i deployed on my machine
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 1.7k
- Forks
- 414
- Avg merge
- 1d 6h
- Merged PRs (30d)
- 14
Description
Chat with onnxruntime-web example deployed with
"onnxruntime-web": "1.19.0-dev.20240509-69cfcba38a"
and associated wasm files from https://cdn.jsdelivr.net/npm/onnxruntime-web@1.19.0-dev.20240509-69cfcba38a/dist/
live demo https://guschmue.github.io/ort-webgpu/chat/index.html works just fine.
When i run locally, i receive the below error
Error: found infinitive in logits at LLM.argmax (llm.js:152:1) at LLM.generate (llm.js:210:1) at async Query (main.js:233:1) | (anonymous) | @ | main.js:141 -- | -- | -- | -- | Promise.catch (async) | | | submitRequest | @ | main.js:140 | (anonymous) | @ | main.js:167Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by comparing the deployed example with the live demo, then inspect llm.js at lines 152 and 210 and main.js at lines 140, 141, 167, and 233. Reproduce the local deployment and determine why logits become infinite; done means the chat example runs locally without the reported error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript, wasm
- Domain
- machine-learning, web-dev
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100