JuliaDataCubes / JuliaDataCubes/EarthDataLab.jl

Cube loads with less variables

Open
#293 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Julia
Stars
34
Forks
14
PR merge metrics
No merged PRs in 30d

Description

I am opening a cube from a location of the FluxNetEO data set and it seems that some variables are missing

c = Cube(filename_modis)
YAXArray with the following dimensions
lon_pixel           Axis with 10 Elements from -5.0 to 4.0
lat_pixel           Axis with 10 Elements from 5.0 to -4.0
time                Axis with 7671 Elements from 2000-01-01T00:00:00 to 2020-12-31T00:00:00
Variable            Axis with 55 elements: BLUE_gapfilltype GREEN .. LST_AQUA_Night NDVI_gapfilltype 
Total size: 321.89 MB
xr.open_dataset(MODIS_path)
<xarray.Dataset>
Dimensions:                            (lat_pixel: 10, lon_pixel: 10, time: 7671)
Coordinates:
  * lat_pixel                          (lat_pixel) float64 5.0 4.0 ... -3.0 -4.0
  * lon_pixel                          (lon_pixel) float64 -5.0 -4.0 ... 3.0 4.0
  * time                               (time) datetime64[ns] 2000-01-01 ... 2...
Data variables: (12/61)
    EVI                                (time, lat_pixel, lon_pixel) float64 ...
    EVI_gapfilltype                    (time, lat_pixel, lon_pixel) float64 ...
    NDVI                               (time, lat_pixel, lon_pixel) float64 ...
    NDVI_gapfilltype                   (time, lat_pixel, lon_pixel) float64 ...
    NIRv                               (time, lat_pixel, lon_pixel) float64 ...
    NIRv_gapfilltype                   (time, lat_pixel, lon_pixel) float64 ...
    ...                                 ...
    LST_gapfilltype_TERRA_Night_VZA40  (time, lat_pixel, lon_pixel) float64 ...
    LST_AQUA_Night_VZA40               (time, lat_pixel, lon_pixel) float64 ...
    LST_gapfilltype_AQUA_Night_VZA40   (time, lat_pixel, lon_pixel) float64 ...
    latitude_1000m                     (lat_pixel, lon_pixel) float64 ...
    longitude_1000m                    (lat_pixel, lon_pixel) float64 ...
    dist_from_tower_1000m              (lat_pixel, lon_pixel) float64 ...
Attributes:
    site_ID:           DE-Har
    institution:       MPI-BGC
    product:           FluxnetEO
    site_coordinates:  47.93439865, 7.600999832
    version:           1.0
    processed_by:      Sophia Walther (sophia.walther@bgc-jena.mpg.de, Ulrich...
    reference:         Walther, S. - Technical note: A view from space on glo...

The variables loaded using EarthDataLab are 55 while the variables in xarray are 61. The missing variables are the only ones not in the (time, lat_pixel, lon_pixel) format it seems

Is this expected? If so what can I do to also load the missing variables?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the Cube(filename_modis) entry point and compare its loaded variables with xr.open_dataset(MODIS_path), focusing on variables that are not shaped as (time, lat_pixel, lon_pixel). Trace how those variables are selected or excluded, then verify that the expected 61 variables can be loaded or that the limitation and workaround are clearly documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
julia, python
Domain
data
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.