JuliaLang / JuliaLang/Distributed.jl
`pmap_reduce` function
Nobody has claimed this yet.
- Dominant language
- Julia
- Stars
- 55
- Forks
- 19
- PR merge metrics
- No merged PRs in 30d
Description
I have need for a pmap_reduce function.
In Julia v0.5 and earlier, I was able to customize the base pmap to provide what I needed.
However since v0.6, parallel processing including pmap has been overhauled and largely rewritten. To a non-expert like me, it is much more complex and impenetrable, compared to the simpler implementation of earlier versions, which is still given as an example in the Parallel Computing section of the manual. https://docs.julialang.org/en/stable/manual/parallel-computing/#Scheduling-1
Are there any issues with continuing in v0.6 and later to model my own pmap_reduce on the v0.5 pmap? What are the benefits of the new implementation of pmap?
Alternatively, would you consider a feature request for an official pmap_reduce?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the Parallel Computing manual's Scheduling section and compare its Julia v0.5 pmap example with the current v0.6-and-later pmap implementation. Investigate the current pmap entry point and determine whether a supported pmap_reduce API is needed, including its expected behavior and benefits over the older approach. Done means the feature scope and API are agreed, with appropriate coverage for the proposed behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- julia
- Domain
- distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 28/100