microsoft / microsoft/onnxruntime

trtexec works, onnxruntime failed to load

Open
#19,180 2 comments 0 reactions 1 assignee Claimed by @chilo-ms View on GitHub
ep:TensorRT
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the issue

I can run trtexec fine, but loading trtexec's pre-built engine with ONNX Runtime gives me an error. How can I solve this? Thank you!
log

### To reproduce

mask2former model

### Urgency

_No response_

### Platform

Linux

### OS Version

Ubuntu 20.04.6 LTS

### ONNX Runtime Installation

Released Package

### ONNX Runtime Version or Commit ID

onnxruntime-linux-x64-gpu-1.16.3.tgz

### ONNX Runtime API

C++

### Architecture

X86

### Execution Provider

TensorRT

### Execution Provider Library Version

TensorRT-8.6.1.6 cuda_11.7 NVIDIA-SMI 460.39 Driver Version: 460.39 Tesla V100

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.