EnzymeAD / EnzymeAD/Enzyme-JAX

Batching of BatchNorm* Ops is Busted

Open
#1,947 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
MLIR
Stars
131
Forks
53
Avg merge
1d 10h
Merged PRs (30d)
193

Description

BatchNorm Ops don't natively support batching if we are also batching the mean/var/scale/bias. We can decompose the op and batch the resulting ops

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the BatchNorm* operation handling and the batching logic for mean, variance, scale, and bias. Determine how to decompose the operation so these inputs can be batched, then verify that batched BatchNorm operations produce the expected result.

Written by the indexing model from the issue text.

Assessment

Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.