pytorch / pytorch/TensorRT

How may I install torch_tensorrt with my own local version of torch?

Open
#2,485 1 comment 0 reactions 1 assignee View on GitHub

@apbose is already working on this.

Since Nov 28, 2023.

question Story: Build & Install & Packaging
Dominant language
Python
Stars
3k
Forks
410
Avg merge
3d 18h
Merged PRs (30d)
78

Description

❓ Question

How may I install torch_tensorrt with my own local version of torch?

What you have already tried

pip install torch-tensorrt --no-deps resulted in

ImportError: /home/jonch/.local/lib/python3.10/site-packages/torch_tensorrt/lib/libtorchtrt.so: undefined symbol: _ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKSs

Seems like it tries to link to torch shared library but fails. I guess I can't configure it to point to my existing installation of torch.

For instance, what if I want to use torch_tensorrt with torch nightly?

Environment

Build information about Torch-TensorRT can be found by turning on debug messages

  • PyTorch Version (e.g., 1.0):
  • CPU Architecture:
  • OS (e.g., Linux):
  • How you installed PyTorch (conda, pip, libtorch, source):
  • Build command you used (if compiling from source):
  • Are you using local sources or building from archives:
  • Python version:
  • CUDA version:
  • GPU models and configuration:
  • Any other relevant information:

Additional context

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.