NVIDIA / NVIDIA/TensorRT

Is there any plan to solve the problem with tensor number < 2^31-1?

Open
#3,815 21 comments 0 reactions 1 assignee View on GitHub

@zerollzeng is already working on this.

Since Apr 25, 2024.

triaged
Dominant language
C++
Stars
13.4k
Forks
2.4k
Avg merge
5d 3h
Merged PRs (30d)
2

Description

In the "Known Issues" of the release note of TensorRT 10.0, it is mentioned that "UNets with tensors containing >2^31 elements may fail during the engine building step." This problem brings great restrictions to our SD deployment, especially Video model, are there any plans to solve this problem in future versions?

Environment

TensorRT Version: V10.0

NVIDIA GPU: A100/A10/H800/H100/T4/2080TI

NVIDIA Driver Version:>510

CUDA Version:12.0

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.