JuliaDataCubes / JuliaDataCubes/YAXArrays.jl

Feature request: Save YAXArray or Dataset into a Zarr group

Open
#348 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Julia
Stars
132
Forks
25
PR merge metrics
No merged PRs in 30d

Description

Multiple Datasets in the Common Data Model V4 can be stored in the same file.
Hereby, they are organized in (nested) groups, analog to files in directories and subdirectories.

For example, xarray.Dataset.to_zarr has the option group to specify the path inside the zarr storage in which the dataset should be stored.
Similarily, zarr.hierarchy.group has the option path to specify the (group) path. The prototype (and part of xarray roadmap) xarray-datatree uses this to represent a tree of Datasets as its own type. I think it is already implemented in Zarr.jl function Zarr.zcreate in option name.

This is of particular importance when it comes to store data cubes of different spatio-temporal resolutions in the same store. I'd be great to have an additional group option to the function savedataset and savecube.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the savedataset and savecube entry points and reading how they currently write Zarr storage. Trace the existing storage path and determine how a group option should map to nested groups; done means both functions can save into the requested group without changing other output behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
julia
Domain
data
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.