Project-MONAI / Project-MONAI/MONAI
Support TensorRT export with dynamo
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 8.7k
- Forks
- 1.6k
- Avg merge
- 5d 1h
- Merged PRs (30d)
- 20
Description
Is your feature request related to a problem? Please describe.
PyTorch introduced the dynamo as a part to compile PyTorch models to different backends. And it also works for the Torch-TensorRT compiler and the Torch-TensorRT team is working on supporting it. Therefore, it would be better to have MONAI trt_export API also support this feature.
Describe the solution you'd like
Add the use_torchscript parameter to the trt_export API to choose whether to use the torchscript as IR. Because the dynamo supports to directly export models from pytorch models instead of the torchscript models.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the trt_export API and reading how it currently selects TorchScript for Torch-TensorRT export. Trace the available model-export paths and determine where a use_torchscript choice belongs. Done means the API can select TorchScript or Dynamo export as requested, with behavior validated for both paths.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100