Integrate Dask Arrays properly
- Dominant language
- Python
- Stars
- 89
- Forks
- 26
- PR merge metrics
- No merged PRs in 30d
Description
We can't currently go from DataFrames to arrays, #445 adds ``to_dask_array`` but this is only a bandaid for now.
I think in an ideal world we have an Array Collection that captures something like ``.values``, then you can do array computations and go back to a DataFrame collection. Downside is that an Array collection without methods is not very helpful
I am not planning on working on this immediately, but wanted to collect thoughts on this topic
cc @mrocklin @rjzamora
Contributor guide
Research direction
Start by reading the discussion on #446 and the related #445 change involving `to_dask_array`; no files, tests, or entry points are named. Before implementation, establish the intended Array Collection scope and its DataFrame conversion behavior, since the issue currently describes an open design discussion rather than a defined completion criterion.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100