JuliaParallel / JuliaParallel/DistributedArrays.jl

Partitions

Open
#208 0 comments 1 reaction 1 assignee Claimed by @vchuravy View on GitHub
enhancement help wanted
Dominant language
Julia
Stars
205
Forks
34
PR merge metrics
No merged PRs in 30d

Description

Right now `DArray` is both the notion of where and the data. I propose to factor out the where into it's own Partitons type, so that we can have a type-hierarchy of partitions, from generic n-dim hypercubes, to partitionings that are only distributed across one axes, to block cyclic or cartesian partitioning.

One important improvement would be that a process can hold more than one chunk and that the chunk array type can be heterogeneous across the `DArray` allowing us to mix something like a FillArray in and represent
block sparsity more efficiently.

Partitions should support reasoning about moving data from A to B, including this data is local (even though it is a different chunk).

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.