deepinsight / deepinsight/insightface

[TensorRT] IRuntime::deserializeCudaEngine: Error Code 6: API Usage Error (The engine plan file is generated on an incompatible device, expecting compute 8.9 got compute 8.6, please rebuild.) [TensorRT error] failed to deserialize engine

Open
#2,882 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
29.7k
Forks
6.1k
PR merge metrics
No merged PRs in 30d

Description

[TensorRT] IRuntime::deserializeCudaEngine: Error Code 6: API Usage Error (The engine plan file is generated on an incompatible device, expecting compute 8.9 got compute 8.6, please rebuild.)
[TensorRT error] failed to deserialize engine
[ERR: InferenceWrapperTensorRT][44] Failed to load TensorRT model
NN Initialize fail

======================================
GPU:4090
CUDA:12.8
TENSORRT:10.8

加载Megatron_TRT时报错,这个怎么解决啊

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.