Batched multiplication support for ndims > 3
- Dominant language
- Julia
- Stars
- 258
- Forks
- 138
- Avg merge
- 2d 1h
- Merged PRs (30d)
- 3
Description
Currently NNlib.batchmul works with arrays with upto 3 dimensions. It would be nice if this could be upgraded to function similar to `numpy.matmul` or `torch.matmul` - this would help in a lot of models, especially some of the attention-based ones I'm working on 😅
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the implementation and tests for the NNlib.batchmul entry point. Compare its current dimensionality behavior with numpy.matmul and torch.matmul, then define the expected behavior for arrays above three dimensions. Done means batchmul supports the requested higher-dimensional cases and has coverage for the new semantics.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- julia
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100