NVIDIA / NVIDIA/TensorRT

Could not find any implementation for node /network.0/network.0.0/norm1/LayerNormalization.

Open
#3,610 8 comments 0 reactions 1 assignee View on GitHub

@zerollzeng is already working on this.

Since Jan 19, 2024.

triaged
Dominant language
C++
Stars
13.4k
Forks
2.4k
Avg merge
5d 3h
Merged PRs (30d)
2

Description

Description

I customized TensorRT's Col2Im plugin, recompiled the source code of TensorRT8.5, and generated a new nvinfer_plugin library.
This is the LayerNormalization node information in the model,

image

So I modified the file plugin/layerNormPlugin/layerNormPlugin.cpp,

- static std::string const kLAYER_NORM_PLUGIN_NAME{"LayerNorm"};
+ static std::string const kLAYER_NORM_PLUGIN_NAME{"LayerNormalization"};

When I started building the model engine, an error message appeared:

WARN:  Skipping tactic 0x0000000000000000 due to exception Assertion status == kSTATUS_SUCCESS failed. 
WARN:  Skipping tactic 0x0000000000000000 due to exception Assertion status == kSTATUS_SUCCESS failed. 
ERROR:  10: [optimizer.cpp::computeCosts::3728] Error Code 10: Internal Error (Could not find any implementation for node /network.0/network.0.0/norm1/LayerNormalization.)
ERROR:  2: [builder.cpp::buildSerializedNetwork::751] Error Code 2: Internal Error (Assertion engine != nullptr failed. )

Environment

TensorRT Version: 8.5.3.1

NVIDIA GPU: GeForce GTX 1080 Ti

NVIDIA Driver Version: 535.146.02

CUDA Version: 11.8

CUDNN Version: 8.6.0

Operating System: ubuntu18.04

May I ask what is the reason for this problem and how to solve it?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.