microsoft / microsoft/onnxruntime

[Feature Request] Enable CUDA Execution Provider in Rust binding

Open
#15,627 1 comment 0 reactions 0 assignees View on GitHub
ep:CUDA feature request
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the feature request

Enable the CUDA execution provider through the Rust binding.

This seems to be supported by [`onnxruntime-sys`](https://github.com/microsoft/onnxruntime/blob/main/rust/onnxruntime-sys/examples/c_api_sample.rs#L68-L70), but it doesn't appear to be exposed by the Rust binding. I believe it is relatively simple, by exposing the `OrtSessionOptionsAppendExecutionProvider_CUDA` function. If a PR would be accepted, let me know :).

### Describe scenario use case

Using CUDA as an execution provider.

Contributor guide

Open the contributing guide

Research direction

Start by inspecting the Rust binding and the onnxruntime-sys C API example linked in the issue, especially the OrtSessionOptionsAppendExecutionProvider_CUDA reference. Compare the exposed execution-provider functions with that example. Done means the CUDA execution provider is available through the Rust binding and the existing binding checks pass.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
machine-learning
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.