huggingface / huggingface/candle
Can I add Qwen Instruct models?
- Dominant language
- Rust
- Stars
- 21k
- Forks
- 1.8k
- Avg merge
- 16h 42m
- Merged PRs (30d)
- 25
Description
Hi, I'm a big fan of candle so I implemented the LLMs below in my [repo](https://github.com/ITHwang/llm-serving-wasm) forked from candle:
- Qwen2-Instruct models including quantized version
- Qwen2.5-Instruct models including quantized version
Furthermore, I published [Qwen2.5 Instruct demo](https://huggingface.co/spaces/ITHwangg/candle-qwen25-wasm-demo) in my huggingface space.
Can I add these qwen models into `candle-examples` and `candle-wasm-examples`?
Contributor guide
No contributing guide indexed for this repository
Research direction
Review the linked llm-serving-wasm fork and the existing candle-examples and candle-wasm-examples areas. Compare its Qwen2 and Qwen2.5 Instruct model coverage, including quantized versions, with the current examples and confirm the scope with maintainers. Done means the agreed Qwen models are added to both example areas.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust, wasm
- Domain
- ai, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100