microsoft / microsoft/onnxruntime
trtexec works, onnxruntime failed to load
Open
ep:TensorRT
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 11h
- Merged PRs (30d)
- 184
Description
### Describe the issue
I can run trtexec fine, but loading trtexec's pre-built engine with ONNX Runtime gives me an error. How can I solve this? Thank you!
### To reproduce
mask2former model
### Urgency
_No response_
### Platform
Linux
### OS Version
Ubuntu 20.04.6 LTS
### ONNX Runtime Installation
Released Package
### ONNX Runtime Version or Commit ID
onnxruntime-linux-x64-gpu-1.16.3.tgz
### ONNX Runtime API
C++
### Architecture
X86
### Execution Provider
TensorRT
### Execution Provider Library Version
TensorRT-8.6.1.6 cuda_11.7 NVIDIA-SMI 460.39 Driver Version: 460.39 Tesla V100
Contributor guide
Assessment
This issue has not been assessed yet.