ROCm / ROCm/AMDMIGraphX

Add EmbedLayerNorm Contrib OP

Open
#4,249 0 comments 0 reactions 1 assignee View on GitHub

@TedThemistokleous is already working on this.

Since Aug 20, 2025.

Onnx Operators Perf Improve
Dominant language
C++
Stars
333
Forks
150
Avg merge
4d 19h
Merged PRs (30d)
54

Description

DOR (Definition of Ready)

Stable diffusion optimizations for workloads that leverage the Onnxruntime framework and MIGraphX EP in some manner looking to leverage Onnxruntime optimizations passes

Description

Task

Add support for the Microsoft Contrib op EmbedLayerNorm
Doc: https://github.com/microsoft/onnxruntime/blob/main/docs/ContribOperators.md#commicrosoftembedlayernormalization

Uses

Seen in Stable diffusion optimizations with Onnxruntime's pipeline's

Seen via using the optimize pipeline script for stable diffusion runs

export MIGRAPHX_DISABLE_CK_GEMM=1
export MIGRAPHX_DISABLE_CK_GEMM_FUSION=1
export MIGRAPHX_DISABLE_CK_GEMM_SOFTMAX_GEMM=1

python optimize_pipeline.py  -i ./sd-v2 -o ./sd-v2-0-migx --float16 --disable_attention  --disable_skip_layer_norm   
--disable_embed_layer_norm --disable_bias_skip_layer_norm  --disable_nhwc_conv   --disable_group_norm 

Reference to the workflow on this found here: https://github.com/ROCm/AMDMIGraphX/issues/1688

Using this would give us the ability to further parse OnnxRT optimizations prior to MIGraphX doing any sort of optimizations

DOD (Definition of Done)
  • Unit tests for MIGraphX parsing and using the operator
  • Parser support in MIGraphX using MIGraphX driver and API
  • Onnxruntime support for operator in MIGraphX EP

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.