FluxML / FluxML/NNlib.jl

Batched multiplication support for ndims > 3

Open
#391 3 comments 1 reaction 0 assignees View on GitHub
Dominant language
Julia
Stars
258
Forks
138
Avg merge
2d 1h
Merged PRs (30d)
3

Description

Currently NNlib.batchmul works with arrays with upto 3 dimensions. It would be nice if this could be upgraded to function similar to `numpy.matmul` or `torch.matmul` - this would help in a lot of models, especially some of the attention-based ones I'm working on 😅

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the implementation and tests for the NNlib.batchmul entry point. Compare its current dimensionality behavior with numpy.matmul and torch.matmul, then define the expected behavior for arrays above three dimensions. Done means batchmul supports the requested higher-dimensional cases and has coverage for the new semantics.

Written by the indexing model from the issue text.

Assessment

Tech stack
julia
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.