huggingface / huggingface/candle

Mistral quantized example: "error: library kind `framework` is only supported on Apple targets"

Open
#1,883 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

```
C:\Users\igumn\candle\candle-examples\examples\mistral>cargo run --example mistral --features accelerate --release -- --prompt "Here is a sample quick sort implementation in rust " --quantized -n 400
Compiling cc v1.0.90
Compiling serde v1.0.197
Compiling getrandom v0.2.12
Compiling rand_core v0.6.4
Compiling syn v1.0.109
Compiling rand_chacha v0.3.1
Compiling winapi v0.3.9
Compiling accelerate-src v0.3.2
error: library kind `framework` is only supported on Apple targets

error: could not compile `accelerate-src` (lib) due to previous error
warning: build failed, waiting for other jobs to finish...
```

Contributor guide

No contributing guide indexed for this repository

Research direction

Start in candle-examples/examples/mistral and reproduce the shown cargo run command with the accelerate feature on the reported Windows environment. Inspect why accelerate-src is compiled for this target and determine the expected behavior for the quantized example; done when the command no longer fails with the Apple-target framework error.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
build-system, machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.