huggingface / huggingface/candle

Tracking: Issues with examples

Open
#2,836 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

Some of the examples don't run.

- ~~`codegeex4_9b`~~
- ~~hangs indefinitely (Likely too slow for cpu)~~
- `colpali`
- pdf seems to be read but getting `Error: i/o error: No such file or directory (os error 2)` anyway.
- ~~`falcon`~~ [`--use-f32`](https://github.com/huggingface/candle/issues/2836#issuecomment-2752750274)
- ~~`Error: unsupported dtype BF16 for op matmul`~~
- ~~For some reason works with `--features metal`~~
- ~~`llava`~~
- ~~hangs indefinitely (Likely too slow for cpu)~~
- `stable-diffusion`
- `Error: cannot seed the CPU rng with set_seed`

System Info:
cargo 1.85.1 (d73d2caf9 2024-12-31)
rustc 1.85.1 (4eb161250 2025-03-15)
Apple M3 Max (36 GB)
MacOS 15.3.2

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the remaining failures in the colpali and stable-diffusion examples on the reported Rust and macOS setup. Read the relevant example entry points and surrounding error handling, then verify that both examples run successfully without the reported errors. The issue lists no specific files or tests, so locating those entry points is part of the work.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.