microsoft / microsoft/onnxruntime

[Feature Request] get cublashandle in custom op

Open
#14,284 1 comment 0 reactions 0 assignees View on GitHub
api feature request
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the feature request

I find that we can get cublashandle in contrib ops, and can we also get that in custom ops like this?
`cublasHandle_t cublas_handle = reinterpret_cast(ort_.KernelContext_GetCublasHandle(context));`

### Describe scenario use case

complicate custom op

Contributor guide

Open the contributing guide

Research direction

Start by comparing how contrib ops obtain cublasHandle_t with the custom-op path, focusing on KernelContext_GetCublasHandle(context). The requested outcome is equivalent cublas handle access for custom ops; determine the relevant custom-op entry points and how the existing contrib-op behavior is exposed before assessing the required tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
backend-api-design, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.