JuliaParallel / JuliaParallel/DistributedArrays.jl
ddata doesn't work as intended when length(data) = length(pids)
- Vorherrschende Sprache
- Julia
- Sterne
- 205
- Forks
- 34
- PR-Merge-Kennzahlen
- Keine gemergten PRs in 30 T.
Beschreibung
The documentation says the following about `ddata`:
> The function `ddata(;T::Type=Any, init::Function=I->nothing, pids=workers(), data::Vector=[])` can be used to created a distributed vector whose localparts need not be Arrays.
> ...
> Argument `data` if supplied is distributed over the `pids`. `length(data)` must be a multiple of `length(pids)`. **If the multiple is 1, returns a `DArray{T,1,T}` where T is `eltype(data)`**. If the multiple is greater than 1, returns a `DArray{T,1,Array{T,1}}`, i.e., it is equivalent to calling `distribute(data)`.
The case when "_the multiple is 1_" is giving me trouble:
```Julia
julia> using Distributed; addprocs(2)
julia> using DistributedArrays
julia> ddata(data=["foo", "bar"])
2-element DArray{String, 1, String}:
ERROR: TypeError: in typeassert, expected String, got a value of type Char
...
```
```Julia
julia> ddata()
ERROR: On worker 2:
MethodError: no method matching getindex(::Nothing, ::Int64)
...
```
Note that `ddata` works as intended for multiples greater than 1:
```julia
julia> ddata(data=["foo", "bar", "foo", "bar"])
4-element DArray{String, 1, Vector{String}}:
"foo"
"bar"
"foo"
"bar"
```
```julia
julia> ddata(;T=Any, init=I->nothing, pids=workers(), data=[nothing, nothing, nothing, nothing])
4-element DArray{Nothing, 1, Vector{Nothing}}:
nothing
nothing
nothing
nothing
```
First time posting an issue, hope I'm doing things right!
Beitragsleitfaden
Für dieses Repository ist kein Beitragsleitfaden indexiert
Rechercherichtung
Start at the ddata entry point and compare its documented behavior with the supplied reproductions for data whose length equals the worker count, including ddata() with no data. Re-run the examples using Distributed and DistributedArrays; done means both cases work without the shown TypeError or MethodError while the documented behavior remains accurate.
Vom Indexierungsmodell aus dem Issue-Text verfasst.
Bewertung
- Tech-Stack
- julia
- Bereich
- data, distributed-systems
- Issue-Typ
- Bug
- Schwierigkeit
- 3/5
- Geschätzter Aufwand
- 1-2 Tage
- Aktivitätsstatus
- Veraltet
- Klarheit
- Größtenteils klar
- Anfängerfreundlichkeit
- 45/100