pytorch/TensorRT

View on GitHub

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

Stars: 3k
Forks: 410
Open beginner issues: 0
Indexed issues: 231
Avg merge: 3d 18h
Merged PRs (30d): 78

Dominant language: Python
License: BSD-3-Clause
Last GitHub push: Sep 17, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

231 open issues indexed

✨[Feature] Performance Tuning Guide Open

feature request story: Documentation & Examples

pytorch/TensorRT#3996 · 1 assignee · Opened Jan 6, 2026
🐛 [Bug] Encountered bug when using Torch-TensorRT Performance gap between ONNIX-TRT and Torch-TRT for Vision Models Open

bug story: Performance & Benchmarking

Difficulty 5/5 Over a week Newbie friendliness 15/100

pytorch/TensorRT#3995 · Opened Jan 6, 2026
📖 [Story] Indicator Models Open

Story story: CI/CD & Testing Infrastructure

pytorch/TensorRT#3994 · 1 assignee · Opened Jan 6, 2026
🐛 [Bug] [NGC] L2 dynamo test failure on ORIN Open

bug story: CI/CD & Testing Infrastructure

pytorch/TensorRT#3982 · 1 comment · 1 assignee · Opened Dec 25, 2025
✨[Feature] Support for 'extra_files' in torch_tensorrt.save/load Open

feature request Story: Runtime & Memory & Serialization

pytorch/TensorRT#3979 · 1 comment · 1 assignee · Opened Dec 19, 2025
🐛 [Bug] FLUX cannot compile with torch.compile(backend="tensorrt") Open

bug story: LLM & Generative AI

Difficulty 4/5 3-5 days Newbie friendliness 45/100

pytorch/TensorRT#3976 · Opened Dec 18, 2025
✨[Feature] A python execute_engine ops that replace PythonTorchTensorRTModule Open

feature request Story: Runtime & Memory & Serialization

pytorch/TensorRT#3975 · 1 assignee · Opened Dec 18, 2025
🐛 [Bug] Shape error with repeat Open

bug story: Dynamic Shapes & Symbolic Tracing

pytorch/TensorRT#3974 · 1 assignee · Opened Dec 18, 2025
🐛 [Bug] 'SymFloat' object has no attribute 'sqrt' Open

bug story: Dynamic Shapes & Symbolic Tracing

pytorch/TensorRT#3973 · 1 comment · 1 assignee · Opened Dec 17, 2025
🐛 [Bug] Shape mismatch when using repeat Open

bug story: Dynamic Shapes & Symbolic Tracing

pytorch/TensorRT#3972 · 1 assignee · Opened Dec 17, 2025
🐛 [Bug] TorchTensorRTRuntime uses more memory than PythonTorchTensorRTRuntime when there are multiple back-to-back engines. Open

bug Story: Runtime & Memory & Serialization

pytorch/TensorRT#3966 · 2 assignees · Opened Dec 12, 2025
🐛 [Bug] Symbolic shape error when using repeat_interleave for K and V followed by SDPA Open

bug story: Dynamic Shapes & Symbolic Tracing

Difficulty 4/5 3-5 days Newbie friendliness 35/100

pytorch/TensorRT#3964 · 2 comments · Opened Dec 10, 2025
✨[Feature] Support prequant model import in run_llm Open

feature request story: LLM & Generative AI

pytorch/TensorRT#3962 · 2 assignees · Opened Dec 9, 2025
✨[Feature] Use a R/W Lock to manage building engines for MGMN setups Open

feature request Story: Multi-GPU & Distributed & Custom Ops

pytorch/TensorRT#3959 · 1 assignee · Opened Dec 9, 2025
📖 [Story] Support Multi-Device Multi-GPU In Torch-TRT Open

Story Story: Multi-GPU & Distributed & Custom Ops

pytorch/TensorRT#3958 · 1 assignee · Opened Dec 9, 2025
✨[Feature] Add CUDA Graph Support for TRT-RTX Open

feature request story: TRT-RTX Platform

pytorch/TensorRT#3956 · 1 assignee · Opened Dec 9, 2025
✨[Feature] Optimize MoE Layers in TRT Open

feature request story: LLM & Generative AI

pytorch/TensorRT#3955 · 1 assignee · Opened Dec 9, 2025
✨[Feature] ONNX vs. ATen Perf Testing. Open

feature request story: Performance & Benchmarking

pytorch/TensorRT#3954 · 1 comment · 1 assignee · Opened Dec 9, 2025
✨[Feature] Pervent Custom Ops from Registering Plugins multiple times Open

feature request Story: Multi-GPU & Distributed & Custom Ops

pytorch/TensorRT#3953 · 1 assignee · Opened Dec 9, 2025
✨[Feature] Add reduction targets in Autocast Open

feature request story: Quantization & Precision

pytorch/TensorRT#3951 · 2 comments · 1 assignee · Opened Dec 5, 2025
✨[Feature] Support automatically generating AOT QDP Plugins Open

feature request Story: Multi-GPU & Distributed & Custom Ops

pytorch/TensorRT#3945 · 1 assignee · Opened Dec 2, 2025
📖 [Story] Support using Custom Kernels in Torch-TensorRT Open

Story Story: Multi-GPU & Distributed & Custom Ops

pytorch/TensorRT#3944 · 1 assignee · Opened Dec 2, 2025
Utilize Resource partitioner to run constrained models Open

story: Dynamo Frontend & Partitioning

pytorch/TensorRT#3943 · 1 assignee · Opened Dec 2, 2025
✨[Feature] Enable refitting on resource-partitioned graphs Open

feature request Story: Runtime & Memory & Serialization

pytorch/TensorRT#3940 · 1 assignee · Opened Dec 2, 2025
✨[Feature] nn.module-defined atomic subgraph Open

feature request story: Dynamo Frontend & Partitioning

pytorch/TensorRT#3939 · 1 assignee · Opened Dec 2, 2025
📖 [Story] Test with New Model Open

Story story: CI/CD & Testing Infrastructure

pytorch/TensorRT#3926 · 1 assignee · Opened Nov 21, 2025
📖 [Story] Weak Typing and AutoCast Open

Story story: Quantization & Precision

pytorch/TensorRT#3925 · 1 assignee · Opened Nov 21, 2025
Convert torch.cond Open

feature request story: Dynamo Frontend & Partitioning

pytorch/TensorRT#3923 · 1 comment · 1 assignee · Opened Nov 21, 2025
📖 [Story] Add Attention API for all models Open

Story story: LLM & Generative AI

pytorch/TensorRT#3921 · 1 assignee · Opened Nov 21, 2025
📖 [Story] Add MOE Model Support Open

Story story: LLM & Generative AI

pytorch/TensorRT#3919 · 1 assignee · Opened Nov 21, 2025
📖 [Story] Runscript for VLA Models Open

Story story: LLM & Generative AI

pytorch/TensorRT#3918 · 1 assignee · Opened Nov 21, 2025
📖 [Story] Integrating with LLM Operators Open

Story story: LLM & Generative AI

pytorch/TensorRT#3917 · 1 assignee · Opened Nov 21, 2025
✨[Feature] Explore using the STABLE_TORCH_LIBRARY API Open

feature request story: Dynamo Frontend & Partitioning

pytorch/TensorRT#3914 · 1 assignee · Opened Nov 20, 2025
✨[Feature] Unify multiple Dynamo compile functions Open

feature request story: Dynamo Frontend & Partitioning

pytorch/TensorRT#3913 · 1 assignee · Opened Nov 20, 2025
Removing ptq.h Open

Story: Build & Install & Packaging

Difficulty 1/5 Under an hour Newbie friendliness 65/100

pytorch/TensorRT#3910 · Opened Nov 19, 2025
✨[Feature] Basic GPU and CPU memory control workflow Open

feature request Story: Runtime & Memory & Serialization

pytorch/TensorRT#3908 · 1 reaction · 1 assignee · Opened Nov 18, 2025
📖 [Story] Resource Usage Optimization Open

Story Story: Runtime & Memory & Serialization

pytorch/TensorRT#3905 · 1 assignee · Opened Nov 18, 2025
🐛 [Bug] The lower_example.py Is Broken In nvcr.io/nvidia/pytorch:25.10-py3 Open

bug story: Documentation & Examples

Difficulty 3/5 1-2 days Newbie friendliness 45/100

pytorch/TensorRT#3901 · 3 comments · Opened Nov 16, 2025
🐛 [Bug] pdist got accuracy issue in dyanmic shape on tensorrt 10.14.1.48 and tensorrt_rtx 1.2 Open

bug story: Operator Coverage & Converters

Difficulty 3/5 1-2 days Newbie friendliness 42/100

pytorch/TensorRT#3898 · Opened Nov 15, 2025
✨[Feature] Supporting Attention masks when used in VLAs Open

feature request story: LLM & Generative AI

pytorch/TensorRT#3880 · 2 assignees · Opened Oct 29, 2025
🐛 [Bug] Dynamic Shape Type Mismatch Error When Using Static Shape Open

bug story: Dynamic Shapes & Symbolic Tracing

pytorch/TensorRT#3876 · 4 comments · 1 assignee · Opened Oct 23, 2025
🐛 [Bug] L0 dynamo converter test failure in TRT-RTX Open

bug story: TRT-RTX Platform

pytorch/TensorRT#3873 · 2 assignees · Opened Oct 20, 2025
🐛 [Bug]Torch distributed data parallel accelerate GPT2 example failing Open

bug Story: Multi-GPU & Distributed & Custom Ops

pytorch/TensorRT#3865 · 1 assignee · Opened Oct 16, 2025
🐛 [Bug] [NGC] L2 Dynamo Test on B200 and H100 Open

bug story: CI/CD & Testing Infrastructure

pytorch/TensorRT#3859 · 2 assignees · Opened Oct 14, 2025
🐛 [Bug] [NGC] L2 Dynamo Test fail on Spark Open

bug story: CI/CD & Testing Infrastructure

pytorch/TensorRT#3858 · 1 comment · 1 assignee · Opened Oct 14, 2025
🐛 [Bug] L2 Dynamo plugin test failure Open

bug story: CI/CD & Testing Infrastructure

pytorch/TensorRT#3855 · 2 comments · 1 assignee · Opened Oct 10, 2025
Torch-TensorRT Debugger Documentation Open

story: Documentation & Examples

pytorch/TensorRT#3847 · 1 assignee · Opened Oct 7, 2025
🐛 [Bug] nn.MultiheadAttention fails with Torch-TensorRT due to non-contiguous tensor before view() Open

bug story: LLM & Generative AI

pytorch/TensorRT#3823 · 1 comment · 1 assignee · Opened Sep 17, 2025
🐛 [Bug] MutableTorchTensorRTModule.save error out in low_vram_mode Open

bug Story: Runtime & Memory & Serialization

Difficulty 4/5 3-5 days Newbie friendliness 25/100

pytorch/TensorRT#3821 · 1 comment · Opened Sep 15, 2025
📖 [Story] Documentation updates Open

Story story: Documentation & Examples

Difficulty 4/5 3-5 days Newbie friendliness 25/100

pytorch/TensorRT#3818 · Opened Sep 15, 2025

pytorch/TensorRT

Get new issues in your inbox