dask / dask/dask-expr

Integrate Dask Arrays properly

Open
#446 14 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
89
Forks
26
PR merge metrics
No merged PRs in 30d

Description

We can't currently go from DataFrames to arrays, #445 adds ``to_dask_array`` but this is only a bandaid for now.

I think in an ideal world we have an Array Collection that captures something like ``.values``, then you can do array computations and go back to a DataFrame collection. Downside is that an Array collection without methods is not very helpful

I am not planning on working on this immediately, but wanted to collect thoughts on this topic

cc @mrocklin @rjzamora

Contributor guide

Open the contributing guide

Research direction

Start by reading the discussion on #446 and the related #445 change involving `to_dask_array`; no files, tests, or entry points are named. Before implementation, establish the intended Array Collection scope and its DataFrame conversion behavior, since the issue currently describes an open design discussion rather than a defined completion criterion.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.