Managing nullable types and empty partitions
Open
- Dominant language
- Python
- Stars
- 951
- Forks
- 262
- PR merge metrics
- No merged PRs in 30d
Description
Hi, I'd like to be able to handle nullable types and empty partitions before making a prediction in Dask-ML.
With the former, Dask DataFrame columns with nullable types can be recast to non-nullable types. With the latter, the empty partitions of the Dask DataFrame can be dropped.
Contributor guide
Research direction
Start at the Dask-ML prediction entry point that receives a Dask DataFrame and inspect how nullable columns and empty partitions are handled before prediction. Add focused tests for nullable-to-non-nullable conversion and empty-partition handling, then verify prediction succeeds for both cases.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100