JuliaParallel / JuliaParallel/DistributedArrays.jl

Handling of DArray input to distributing functions

Open
#107 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Julia
Stars
205
Forks
34
PR merge metrics
No merged PRs in 30d

Description

This is not what you want

``` jl
julia> distribute(distribute(randn(4)))
4-element DistributedArrays.DArray{Float64,1,SubArray{Float64,1,DistributedArrays.DArray{Float64,1,Array{Float64,1}},Tuple{UnitRange{Int64}},false}}:
1.27283
-0.642431
-0.585599
-1.96976
```

The most general solutino might be to change `verified_destination_serializer`. Alternatively, we'll have to add special `DArray` methods for each method defined for `AbstractArray`. @amitmurthy thoughts?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the nested distribute(randn(4)) example from the issue, then read verified_destination_serializer and the existing DArray methods for AbstractArray operations. Determine whether the fix belongs in the serializer or requires special DArray methods; done means nested distribution no longer produces the unwanted DArray type and the behavior has regression coverage.

Written by the indexing model from the issue text.

Assessment

Tech stack
julia
Domain
distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.