Add TensorRT Support.
Open
- Dominant language
- C#
- Stars
- 1.9k
- Forks
- 228
- PR merge metrics
- No merged PRs in 30d
Description
It would be fantastic if `TensorRT` support is added to TorchSharp directly (at least on the CUDA variants). `TensorRT` performance (due to kernel optimizations) beats regular PyTorch inference performance by magnitudes. It would be great to see this implemented.
https://github.com/NVIDIA-AI-IOT/torch2trt
Contributor guide
Assessment
This issue has not been assessed yet.