Add EmbedLayerNorm Contrib OP
@TedThemistokleous is already working on this.
Since Aug 20, 2025.
- Dominant language
- C++
- Stars
- 333
- Forks
- 150
- Avg merge
- 4d 19h
- Merged PRs (30d)
- 54
Description
DOR (Definition of Ready)
Stable diffusion optimizations for workloads that leverage the Onnxruntime framework and MIGraphX EP in some manner looking to leverage Onnxruntime optimizations passes
Description
Task
Add support for the Microsoft Contrib op EmbedLayerNorm
Doc: https://github.com/microsoft/onnxruntime/blob/main/docs/ContribOperators.md#commicrosoftembedlayernormalization
Uses
Seen in Stable diffusion optimizations with Onnxruntime's pipeline's
Seen via using the optimize pipeline script for stable diffusion runs
export MIGRAPHX_DISABLE_CK_GEMM=1
export MIGRAPHX_DISABLE_CK_GEMM_FUSION=1
export MIGRAPHX_DISABLE_CK_GEMM_SOFTMAX_GEMM=1
python optimize_pipeline.py -i ./sd-v2 -o ./sd-v2-0-migx --float16 --disable_attention --disable_skip_layer_norm
--disable_embed_layer_norm --disable_bias_skip_layer_norm --disable_nhwc_conv --disable_group_norm
Reference to the workflow on this found here: https://github.com/ROCm/AMDMIGraphX/issues/1688
Using this would give us the ability to further parse OnnxRT optimizations prior to MIGraphX doing any sort of optimizations
DOD (Definition of Done)
- Unit tests for MIGraphX parsing and using the operator
- Parser support in MIGraphX using MIGraphX driver and API
- Onnxruntime support for operator in MIGraphX EP
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.