NVIDIA / NVIDIA/TensorRT

Could not find any implementation for node /model.22/proto/cv3/conv/Conv + PWN(PWN(/model.22/proto/cv3/act/Sigmoid), /model.22/proto/cv3/act/Mul). failure of TensorRT 8.6.1 when running C++ TensorRT.trtexec on GPU GeForce RTX 4060

Open
#4,555 3 comments 0 reactions 1 assignee View on GitHub

@kevinch-nv is already working on this.

Since Aug 14, 2025.

Module:Quantization triaged
Dominant language
C++
Stars
13.4k
Forks
2.4k
Avg merge
5d 3h
Merged PRs (30d)
2

Description

Description

In windows system , I use tensorRT C++ tools trtexec.exe to quantificat yolov8n-seg.onnx fails with error :

Could not find any implementation for node /model.22/proto/cv3/conv/Conv + PWN(PWN(/model.22/proto/cv3/act/Sigmoid), /model.22/proto/cv3/act/Mul).

My input:
trtexec --onnx=yolov8n-seg.onnx --int8 --saveEngine=yolov8s-seg-int8.engine --calib=none --workspace=4096 --verbose --minShapes=images:1x3x640x640 --optShapes=images:4x3x640x640 --maxShapes=images:8x3x640x640

Use tensorRT 8.6.1 C++ API to quantization is the same error!!!

Use tensorRT 8.6.1 python API to quantization is fine!!!!

I have tried the higher version of tensorRT, but the same error still occurred.

Do the two versions have any different processing methods for the YOLOv8 segmentation model?
I want to use the C++ interface to conduct quantitative analysis.

Could you please help me solve this problem? Thank you very much.

The attachment contains my complete log and code.
yolov8_tensorRT.zip

Environment

TensorRT Version: 8.6.1

NVIDIA GPU: GeForce RTX 4060

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Tue_Feb_27_16:28:36_Pacific_Standard_Time_2024
Cuda compilation tools, release 12.4, V12.4.99
Build cuda_12.4.r12.4/compiler.33961263_0

[08/14/2025-18:48:50] [I] [TRT] Input filename: yolov8n-seg.onnx
[08/14/2025-18:48:50] [I] [TRT] ONNX IR version: 0.0.7
[08/14/2025-18:48:50] [I] [TRT] Opset version: 13
[08/14/2025-18:48:50] [I] [TRT] Producer name: pytorch
[08/14/2025-18:48:50] [I] [TRT] Producer version: 2.4.0
[08/14/2025-18:48:50] [I] [TRT] Domain:
[08/14/2025-18:48:50] [I] [TRT] Model version: 0
[08/14/2025-18:48:50] [I] [TRT] Doc string:

MyLog:

(base) C:\Users\Administrator\Desktop\yolov8_tensorRT>trtexec --onnx=yolov8n-seg.onnx --int8 --saveEngine=yolov8s-seg-int8.engine --calib=none --workspace=4096 --verbose --minShapes=images:1x3x640x640 --optShapes=images:4x3x640x640 --maxShapes=images:8x3x640x640 >log2.txt
[08/14/2025-19:27:58] [W] --workspace flag has been deprecated by --memPoolSize flag.
[08/14/2025-19:28:03] [W] [TRT] onnx2trt_utils.cpp:374: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor /model.22/Squeeze_output_0, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor /model.22/Squeeze_1_output_0, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor /model.22/Squeeze_2_output_0, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 367) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 368) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 378) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 382) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 383) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 393) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor /model.22/Reshape_6_output_0, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor /model.22/Reshape_7_output_0, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 457) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 458) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 468) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 472) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 473) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 483) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor /model.22/Reshape_11_output_0, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor /model.22/Reshape_12_output_0, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 547) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 548) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 558) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 562) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 563) [Constant]_output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 573) [Constant]output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor /model.22/Reshape_16_output_0, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor /model.22/Reshape_17_output_0, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor /model.22/dfl/Softmax_output_0, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
[08/14/2025-19:28:56] [W] [TRT] Missing scale and zero-point for tensor (Unnamed Layer* 739) [Constant]output, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
**
[08/14/2025-19:33:23] [E] Error[10]: Could not find any implementation for node /model.22/proto/cv3/conv/Conv + PWN(PWN(/model.22/proto/cv3/act/Sigmoid), /model.22/proto/cv3/act/Mul).
[08/14/2025-19:33:23] [E] Error[10]: [optimizer.cpp::nvinfer1::builder::cgraph::LeafCNode::computeCosts::3869] Error Code 10: Internal Error (Could not find any implementation for node /model.22/proto/cv3/conv/Conv + PWN(PWN(/model.22/proto/cv3/act/Sigmoid), /model.22/proto/cv3/act/Mul).)
**
[08/14/2025-19:33:23] [E] Engine could not be created from network
[08/14/2025-19:33:23] [E] Building engine failed
[08/14/2025-19:33:23] [E] Failed to create engine from model or file.
[08/14/2025-19:33:23] [E] Engine set up failed

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.