huggingface / huggingface/candle

Write CUDA kernels in Rust

Open
#3,683 1 comment 3 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

Hi there, I wanna bring this up that https://github.com/NVlabs/cuda-oxide has been actively developed, and the way of writing kernels in `.cu` can be ported to Rust.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the linked cuda-oxide project and Candle's existing kernel approach, comparing the current .cu workflow with the proposed Rust workflow. Before coding, define which kernels and integration points are in scope; done should include a working Rust kernel path in Candle and evidence that the relevant existing behavior is preserved.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.