JuliaDataCubes / JuliaDataCubes/YAXArrays.jl
open_mfdataset fails when datacubes have different chunking
Nobody has claimed this yet.
- Dominant language
- Julia
- Stars
- 132
- Forks
- 25
- PR merge metrics
- No merged PRs in 30d
Description
I am not sure what we can do about it, but if we try to open two datasets that have a slightly different chunking via open_mfdataset this fails with an Argument Error: Chunk sizes do not form a grid.
It would be nice, if we could try to circumvent this error by setting the chunks of the cubes all to the same chunking structure.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start at the open_mfdataset entry point and reproduce the failure with datasets that have different chunking structures. Trace how chunk sizes are validated, then make the datasets use a compatible common chunking so opening them succeeds without the grid error. Done means the reported case works and an appropriate regression test covers it.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- julia
- Domain
- data
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100