deepinsight / deepinsight/insightface
[TensorRT] IRuntime::deserializeCudaEngine: Error Code 6: API Usage Error (The engine plan file is generated on an incompatible device, expecting compute 8.9 got compute 8.6, please rebuild.) [TensorRT error] failed to deserialize engine
Open
- Dominant language
- Python
- Stars
- 29.7k
- Forks
- 6.1k
- PR merge metrics
- No merged PRs in 30d
Description
[TensorRT] IRuntime::deserializeCudaEngine: Error Code 6: API Usage Error (The engine plan file is generated on an incompatible device, expecting compute 8.9 got compute 8.6, please rebuild.)
[TensorRT error] failed to deserialize engine
[ERR: InferenceWrapperTensorRT][44] Failed to load TensorRT model
NN Initialize fail
======================================
GPU:4090
CUDA:12.8
TENSORRT:10.8
加载Megatron_TRT时报错,这个怎么解决啊
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.