`mapreducedim!` is super slow
- Dominant language
- Julia
- Stars
- 312
- Forks
- 50
- Avg merge
- 1d 1h
- Merged PRs (30d)
- 11
Description
Reductions on CLArrays seem to be almost 100x slower than Base (This is with the pocl CPU backend):
```julia-repl
julia> using OpenCL, pocl_jll
julia> X = rand(Float32, 1000, 1000);
julia> X′ = CLArray(X);
julia> @benchmark sum(X; dims = 1)
BenchmarkTools.Trial: 10000 samples with 1 evaluation per sample.
Range (min … max): 58.380 μs … 922.617 μs ┊ GC (min … max): 0.00% … 0.00%
Time (median): 90.710 μs ┊ GC (median): 0.00%
Time (mean ± σ): 103.658 μs ± 35.143 μs ┊ GC (mean ± σ): 0.00% ± 0.00%
▄▃▁ ▃▇█▃
▁▁▁▂▄█████████▆▆▆▅▅▄▄▃▂▃▃▃▃▄▃▃▂▂▂▂▃▃▃▃▃▂▂▂▂▂▂▂▂▂▂▂▁▁▁▁▁▁▁▁▁▁▁ ▃
58.4 μs Histogram: frequency by time 212 μs <
Memory estimate: 4.02 KiB, allocs estimate: 3.
julia> @benchmark OpenCL.synchronize(sum(X′; dims = 1))
BenchmarkTools.Trial: 653 samples with 1 evaluation per sample.
Range (min … max): 5.585 ms … 12.908 ms ┊ GC (min … max): 0.00% … 0.00%
Time (median): 7.424 ms ┊ GC (median): 0.00%
Time (mean ± σ): 7.604 ms ± 1.126 ms ┊ GC (mean ± σ): 0.00% ± 0.00%
▁▁▁▂▃▁▄█ ▁▇▇▃▄▄▄▃▄▂▃▂▃▁▁▃▁
▃▂▃▅▆██████████████████████████▇▆█▇▄▇▇█▆▅▇▄▁▄▅▄▄▃▃▅▄▃▂▂▂▂▃ ▅
5.59 ms Histogram: frequency by time 10.6 ms <
Memory estimate: 22.52 KiB, allocs estimate: 247.
```
Is there any low-hanging fruit in terms of optimizations here?
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the `mapreducedim!` reduction path and reproduce the supplied `sum(X; dims = 1)` versus `sum(X′; dims = 1)` benchmarks using the pocl CPU backend. Profile or inspect the reduction entry point to identify avoidable overhead, then rerun the benchmark and verify that the synchronized CLArray reduction is measurably faster.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- julia
- Domain
- performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 38/100