huggingface / huggingface/candle
Plans to support AMD
Open
- Dominant language
- Rust
- Stars
- 21k
- Forks
- 1.8k
- Avg merge
- 16h 42m
- Merged PRs (30d)
- 25
Description
Are there any plans to support inference with AMD gpus? As far as I can tell in Candle there is only support for NVIDIA gpus.
i am working on safe rust wrappers for the rocm stack here:
https://github.com/radudiaconu0/rocm-rs
maybe you are interested in this. And we can collaborate somehow.
Contributor guide
No contributing guide indexed for this repository
Research direction
Review Candle’s existing NVIDIA GPU support and the linked rocm-rs project to understand the current options for AMD inference. The issue does not identify files, tests, or a defined implementation scope; it is complete only when the project’s AMD support direction and concrete work are agreed.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100