pytorch / pytorch/TensorRT

✨[Feature] Support automatically generating AOT QDP Plugins

Open
#3,945 0 comments 0 reactions 1 assignee View on GitHub

Nobody has claimed this yet.

feature request Story: Multi-GPU & Distributed & Custom Ops
Dominant language
Python
Stars
3k
Forks
410
Avg merge
3d 18h
Merged PRs (30d)
78

Description

Is your feature request related to a problem? Please describe.

We support generating JIT QDP plugins automatically from PyTorch custom op registrations, but the performance makes them pretty unusable. Therefore we should figure out how to simplify the registration of the AOT QDP Plugins or present a short workflow for users to reuse what they already did for PyTorch for the QDP registration and implementation

Describe the solution you'd like

Describe alternatives you've considered

Additional context

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.