createEngine failure of TensorRT 8.6
Open
@zerollzeng is already working on this.
Since Oct 15, 2023.
triaged
- Dominant language
- C++
- Stars
- 13.4k
- Forks
- 2.4k
- Avg merge
- 5d 3h
- Merged PRs (30d)
- 2
Description
Description
When converting an onnx DETR-series model with Swin-large backbone to tensorrt engine, AssertionError:
command:
trtexec --onnx=model.onnx --workspace=8192 --fp16 --plugins=libmmdeploy_tensorrt_ops.so --saveEngine=model.plan --device=5
Error Code 10: Internal Error (Could not find any implementation for node {ForeignNode[/backbone/stages.0/blocks.1/attn/Constant_43_output_0 + (Unnamed Layer* 458) [Shuffle].../backbone/Reshape_3 + /backbone/Transpose_3]}
Environment
TensorRT Version: 8.6
NVIDIA GPU: T4
NVIDIA Driver Version: 460.32.03
CUDA Version: 11.6
Relevant Files
Model link:
https://drive.google.com/file/d/1sU_OoV2FEThnxkJz9lMltueZEkR7iNdR/view?usp=drive_link
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.