dotnet / dotnet/TorchSharp

Support CUDA streams

Open
#1,431 3 comments 1 reaction 0 assignees View on GitHub
Missing Feature question
Dominant language
C#
Stars
1.9k
Forks
228
PR merge metrics
No merged PRs in 30d

Description

PyTorch includes [CUDA streams](https://pytorch.org/docs/stable/notes/cuda.html#cuda-streams), which let multiple GPU requests run in parallel.

However it appears that TorchSharp does not support CUDA streams. I searched the codebase and can't find anything like PyTorch's torch.cuda.Stream class, or C# wrappers for e.g. the wait_stream(), default_stream() and record_stream() methods.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.