huggingface / huggingface/candle
`cudarc` dynamic loading support
- Dominant language
- Rust
- Stars
- 21k
- Forks
- 1.8k
- Avg merge
- 16h 42m
- Merged PRs (30d)
- 25
Description
Currently, `candle` uses `cudarc` with the `dynamic-linking` feature, which requires the executable to find the DLLs or SOs at startup. However, it would be more convenient if `candle` also supported the `dynamic-loading` feature from `cudarc` to load DLLs or SOs at runtime.
Is it possible for `candle` to support it?
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reviewing Candle's current use of cudarc's dynamic-linking feature and the dynamic-loading option described in the issue. Confirm the runtime-loading requirements and define done as Candle supporting DLL or SO loading at runtime without requiring them at executable startup.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100