NVIDIA / NVIDIA/TensorRT

Given an engine file, how to know what GPU model it is generated on?

Open
#4,233 9 comments 0 reactions 1 assignee View on GitHub

@kevinch-nv is already working on this.

Since Nov 6, 2024.

Feature Request triaged
Dominant language
C++
Stars
13.4k
Forks
2.4k
Avg merge
5d 3h
Merged PRs (30d)
2

Description

When I use trtexec and I mix TensorRT engine plan files across different GPU models, I can get a warning:

Using an engine plan file across different models of devices is not recommended and is likely to affect performance or even cause errors

I would also like to do this check in my own program, but I cannot find an API to get what GPU model an engine file is generated on. For a similar question, "what TensorRT version is an engine file generated on", I find that I can know the answer using https://github.com/NVIDIA/TensorRT/issues/3073#issuecomment-1599934548. I'm wondering if there is any similar trick for GPU model information. Thanks a lot!

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.