Convert xarray dataset to dask dataframe or delayed objects
Open
Nobody has claimed this yet.
topic-dask
- Dominant language
- Python
- Stars
- 4.2k
- Forks
- 1.4k
- Avg merge
- 2d 15h
- Merged PRs (30d)
- 14
Description
It would be great to have a function like dask's to_delayed in order to take xarray datasets and convert them to pandas dataframes chunkily.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the issue and the linked Stack Overflow discussion, then compare the requested behavior with dask's to_delayed conversion. Establish how xarray datasets should be chunked into pandas dataframes or delayed objects and what dataset shapes and chunking cases must be supported. Done means the conversion behavior and its scope are clearly defined and implemented with coverage for the supported cases.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- pandas, python
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100