Given an engine file, how to know what GPU model it is generated on?
Open
@kevinch-nv is already working on this.
Since Nov 6, 2024.
Feature Request
triaged
- Dominant language
- C++
- Stars
- 13.4k
- Forks
- 2.4k
- Avg merge
- 5d 3h
- Merged PRs (30d)
- 2
Description
When I use trtexec and I mix TensorRT engine plan files across different GPU models, I can get a warning:
Using an engine plan file across different models of devices is not recommended and is likely to affect performance or even cause errors
I would also like to do this check in my own program, but I cannot find an API to get what GPU model an engine file is generated on. For a similar question, "what TensorRT version is an engine file generated on", I find that I can know the answer using https://github.com/NVIDIA/TensorRT/issues/3073#issuecomment-1599934548. I'm wondering if there is any similar trick for GPU model information. Thanks a lot!
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.