Support CUDA streams
Open
Missing Feature
question
- Dominant language
- C#
- Stars
- 1.9k
- Forks
- 228
- PR merge metrics
- No merged PRs in 30d
Description
PyTorch includes [CUDA streams](https://pytorch.org/docs/stable/notes/cuda.html#cuda-streams), which let multiple GPU requests run in parallel.
However it appears that TorchSharp does not support CUDA streams. I searched the codebase and can't find anything like PyTorch's torch.cuda.Stream class, or C# wrappers for e.g. the wait_stream(), default_stream() and record_stream() methods.
Contributor guide
Assessment
This issue has not been assessed yet.