huggingface / huggingface/candle

`panic!` when running on tvOS simulator with `mistral.rs`

Open
#3,552 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

I could be wrong, but #3392 fixed the `objc2-metal` part, now the panic moves to `candle-metal-kernels`:

```

["/Users/setoelkahfi/Library/Developer/CoreSimulator/Devices/46701E1E-99C5-49BC-B577-FE1AFB628421/data/Containers/Shared/AppGroup/BA7ABCE3-CDB8-46A7-ABEC-C3CF52EABF58/models/hub/models--bartowski--Qwen2.5-1.5B-Instruct-GGUF/snapshots/9eadc66189c7641e1ddd226b8267a9119b2ce2d4/Qwen2.5-1.5B-Instruct-Q4_K_M.gguf"]
2026-05-20T03:29:32.613355Z  INFO onde_mistralrs_core::pipeline::gguf: Prompt chunk size is 1024.
2026-05-20T03:29:32.867097Z  INFO onde_mistralrs_core::gguf::content: Model config:
general.architecture: qwen2
general.base_model.0.name: Qwen2.5 1.5B
general.base_model.0.organization: Qwen
general.base_model.0.repo_url: https://huggingface.co/Qwen/Qwen2.5-1.5B
general.base_model.count: 1
general.basename: Qwen2.5
general.file_type: 15
general.finetune: Instruct
general.languages: en
general.license: apache-2.0
general.license.link: https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct/blob/main/LICENSE
general.name: Qwen2.5 1.5B Instruct
general.quantization_version: 2
general.size_label: 1.5B
general.tags: chat, text-generation
general.type: model
quantize.imatrix.chunks_count: 128
quantize.imatrix.dataset: /training_dir/calibration_datav3.txt
quantize.imatrix.entries_count: 196
quantize.imatrix.file: /models_out/Qwen2.5-1.5B-Instruct-GGUF/Qwen2.5-1.5B-Instruct.imatrix
qwen2.attention.head_count: 12
qwen2.attention.head_count_kv: 2
qwen2.attention.layer_norm_rms_epsilon: 0.000001
qwen2.block_count: 28
qwen2.context_length: 32768
qwen2.embedding_length: 1536
qwen2.feed_forward_length: 8960
qwen2.rope.freq_base: 1000000
2026-05-20T03:29:33.030061Z ERROR onde: Rust panic at /Users/runner/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/candle-metal-kernels-0.10.2/src/metal/device.rs:111:14: called `Result::unwrap()` on an `Err` value: NSError { code: 2, localizedDescription: "Compilation failed due to an interrupted connection: XPC_ERROR_CONNECTION_INTERRUPTED. This error occurred after multiple retries.", domain: "CompilerError", userInfo: {"NSLocalizedDescription": <__NSCFString: 0x6000033330c0>}, .. }
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.