Upcoming major improvements
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 366
- Forks
- 96
- Avg merge
- 24m
- Merged PRs (30d)
- 1
Description
Stuff that would be cool to get done and is well within out capacity. Please vote if you have favourites here!
- automagically run combine in dask tree reduction mode #255
- split to subchunk utility for uncompressed data. #251
- concatenate from subchunks for irregular inputs and primitive sharding support
- coords generation (e.g., FITS WCS, geoTIFF bounding boxes) for flexible xarray indexes (partial: #192 )
- parquet storage (from preffs) #277 with
- lazy loading
- sorted key partitioning
- subsampling and multiscale pyramid generation
- checksums or other UUIDs for remote files, to check for changes
- linked zarr/numcodecs: allow for read context to be passed to codec and storage layer, so that we can, for instance, apply a different scale to a cube at each pane https://github.com/zarr-developers/zarr-python/pull/1131
- consolidate (nearly) adjoining reads in ReferenceFileSystem as is done in fsspec.parquet https://github.com/fsspec/filesystem_spec/pull/1063
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
This is a broad roadmap covering several unchecked features, including irregular subchunk concatenation, parquet storage, multiscale generation, checksums, and linked codec/storage context. Start by selecting one item and finding its existing implementation or a focused follow-up issue; the relevant files, tests, and definition of done are not identified here.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 18/100