huggingface / huggingface/candle
`panic!` when running on tvOS simulator with `mistral.rs`
- Dominant language
- Rust
- Stars
- 21k
- Forks
- 1.8k
- Avg merge
- 16h 42m
- Merged PRs (30d)
- 25
Description
I could be wrong, but #3392 fixed the `objc2-metal` part, now the panic moves to `candle-metal-kernels`:
```
["/Users/setoelkahfi/Library/Developer/CoreSimulator/Devices/46701E1E-99C5-49BC-B577-FE1AFB628421/data/Containers/Shared/AppGroup/BA7ABCE3-CDB8-46A7-ABEC-C3CF52EABF58/models/hub/models--bartowski--Qwen2.5-1.5B-Instruct-GGUF/snapshots/9eadc66189c7641e1ddd226b8267a9119b2ce2d4/Qwen2.5-1.5B-Instruct-Q4_K_M.gguf"]
[2m2026-05-20T03:29:32.613355Z[0m [32m INFO[0m [2monde_mistralrs_core::pipeline::gguf[0m[2m:[0m Prompt chunk size is 1024.
[2m2026-05-20T03:29:32.867097Z[0m [32m INFO[0m [2monde_mistralrs_core::gguf::content[0m[2m:[0m Model config:
general.architecture: qwen2
general.base_model.0.name: Qwen2.5 1.5B
general.base_model.0.organization: Qwen
general.base_model.0.repo_url: https://huggingface.co/Qwen/Qwen2.5-1.5B
general.base_model.count: 1
general.basename: Qwen2.5
general.file_type: 15
general.finetune: Instruct
general.languages: en
general.license: apache-2.0
general.license.link: https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct/blob/main/LICENSE
general.name: Qwen2.5 1.5B Instruct
general.quantization_version: 2
general.size_label: 1.5B
general.tags: chat, text-generation
general.type: model
quantize.imatrix.chunks_count: 128
quantize.imatrix.dataset: /training_dir/calibration_datav3.txt
quantize.imatrix.entries_count: 196
quantize.imatrix.file: /models_out/Qwen2.5-1.5B-Instruct-GGUF/Qwen2.5-1.5B-Instruct.imatrix
qwen2.attention.head_count: 12
qwen2.attention.head_count_kv: 2
qwen2.attention.layer_norm_rms_epsilon: 0.000001
qwen2.block_count: 28
qwen2.context_length: 32768
qwen2.embedding_length: 1536
qwen2.feed_forward_length: 8960
qwen2.rope.freq_base: 1000000
[2m2026-05-20T03:29:33.030061Z[0m [31mERROR[0m [2monde[0m[2m:[0m Rust panic at /Users/runner/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/candle-metal-kernels-0.10.2/src/metal/device.rs:111:14: called `Result::unwrap()` on an `Err` value: NSError { code: 2, localizedDescription: "Compilation failed due to an interrupted connection: XPC_ERROR_CONNECTION_INTERRUPTED. This error occurred after multiple retries.", domain: "CompilerError", userInfo: {"NSLocalizedDescription": <__NSCFString: 0x6000033330c0>}, .. }
```
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.