EnzymeAD / EnzymeAD/Enzyme-JAX
Batching of BatchNorm* Ops is Busted
Open
- Dominant language
- MLIR
- Stars
- 131
- Forks
- 53
- Avg merge
- 1d 10h
- Merged PRs (30d)
- 193
Description
BatchNorm Ops don't natively support batching if we are also batching the mean/var/scale/bias. We can decompose the op and batch the resulting ops
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the BatchNorm* operation handling and the batching logic for mean, variance, scale, and bias. Determine how to decompose the operation so these inputs can be batched, then verify that batched BatchNorm operations produce the expected result.
Written by the indexing model from the issue text.
Assessment
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100