microsoft / microsoft/onnxruntime

How to force specific type of operators to run on CPU?

Open
#14,864 1 comment 2 reactions 0 assignees View on GitHub
ep:CUDA feature request
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

There're non-deterministic operators like RandomUniform, RandomNormalLike, I want all these operators to compute back on CPU when using other execution providers especially CUDA.

Contributor guide

Open the contributing guide

Research direction

No source file, test, or entry point is named. Start by locating how RandomUniform and RandomNormalLike are assigned to execution providers, then determine whether CPU placement can be requested for selected operators and how completion should be verified across CUDA and other providers.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, machine-learning
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.