microsoft / microsoft/onnxruntime

[Feature Request] Nvidia TensorRT RTX runtime in C#

Open
#25,630 3 comments 2 reactions 0 assignees View on GitHub
api:CSharp ep:TensorRT feature request
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the feature request

The option to enable the TensorRT RTX runtime in C# does not exist.
DirectML is too slow, the other options aren't portable

### Describe scenario use case

I want to ship my inference application to my customers, have them run the network at max speed, but not ship the 6GB DLL's of CUDA and CUDNN.

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Start by locating the C# TensorRT execution-provider integration and how runtime selection currently works; done means the TensorRT RTX runtime can be enabled from C# without shipping CUDA or CUDNN DLLs.

Written by the indexing model from the issue text.

Assessment

Tech stack
csharp
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.