microsoft / microsoft/PlanetaryComputerExamples
multiple reads of nasa-nex-gddp-cmip6 dataset from MultiZarrToZarr concatenated metadata returns all nans
Nobody has claimed this yet.
- Dominant language
- Jupyter Notebook
- Stars
- 455
- Forks
- 225
- PR merge metrics
- No merged PRs in 30d
Description
Simply running twice cells 13 & 14 of the notebook that read and plot point single variable time-series for a point will reproduce this issue where the first run will have the valid values but second will be all nans. I encountered this when parallelizing reading of the files with dask that results in multiple reads and the unexpected result.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with cells 13 and 14 in datasets/nasa-nex-gddp-cmip6/nasa-nex-gddp-cmip6-example.ipynb and reproduce the point time-series read twice. Inspect the MultiZarrToZarr concatenated metadata behavior, including repeated or parallel reads. Done means the second read returns the same valid values as the first rather than all NaNs.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- jupyter-notebook
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100