JuliaDataCubes / JuliaDataCubes/EarthDataLab.jl
Integration with Pangeo data
Nobody has claimed this yet.
- Dominant language
- Julia
- Stars
- 34
- Forks
- 14
- PR merge metrics
- No merged PRs in 30d
Description
Now that we are able to read xarray-flavored zarr into our cube format, it should be possible to directly process the Pangeo-hosted CMIP6 data. Given that the PR at AWSCore gets merged, there should be no obstacles. Here is a short gist https://gist.github.com/meggart/2d544be2c1368f8774d0a21ea4633985 showing some (meaningless) processing on the Pangeo data done from my laptop. Of course this assumes the respective branches of AWSCore and Zarr are installed.
@rabernat from your comments in other threads it looks like you are interested in making the Pangeo data accessible to Julia users, maybe you could comment if this would be of any use for you?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the linked gist and the existing xarray-flavored Zarr-to-cube support. Check the referenced AWSCore and Zarr branches and their merge status before defining how Pangeo-hosted CMIP6 data should be processed. Done should mean a documented, working path for processing that data directly from Julia.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- julia
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100