huggingface / huggingface/candle
Dynamic linking feature breaks pyo3 wrappers
Open
- Dominant language
- Rust
- Stars
- 21k
- Forks
- 1.8k
- Avg merge
- 16h 42m
- Merged PRs (30d)
- 25
Description
Adding dynamic-linking feature from commit:
https://github.com/huggingface/candle/commit/d9bc5ec15164ecb583dbb25653edd89e08e6cbd0
breaks usage with pyo3 and cuda.
With this feature python throws: "thread panicked while processing panic. aborting"
on models loading with cuda device.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by comparing the dynamic-linking change in commit d9bc5ec15164ecb583dbb25653edd89e08e6cbd0 with the pyo3 wrapper and CUDA model-loading path. Reproduce the reported panic while loading a model on a CUDA device; done means Python wrappers can load CUDA models without aborting.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, rust
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100