NVIDIA / NVIDIA/TensorRT

setmaxworkspace failure of TensorRT 8.5 from onnx to tensorrt. when running transfer on GPU 4060

Open
#3,888 6 comments 0 reactions 1 assignee View on GitHub

@brb-nv is already working on this.

Since May 22, 2024.

triaged
Dominant language
C++
Stars
13.4k
Forks
2.4k
Avg merge
5d 3h
Merged PRs (30d)
2

Description

The GPU memory size of setmaxworkspace can affect the conversion from onnx to tensorrt. 4096MB sometimes succeeds and sometimes fails, while 1024MB reports an error. What is the reason for this.

B760 for motherboard, then 13th generation CPU, paired with 4060 graphics card

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.