google-deepmind / google-deepmind/weathernext

ERA5 data preprocessing steps

Open
#143 7 comments 7 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.7k
Forks
986
PR merge metrics
No merged PRs in 30d

Description

If we fetch data directly from copernicus climate data store using cdsapi than what are preprocessing steps are used before loading this weather data with model. Right now its not matching with model and sample data available on google cloud strorage are compatible and valid. So whats the actual difference in it.

Contributor guide

Open the contributing guide

Research direction

Compare data fetched through cdsapi with the sample data stored in Google Cloud Storage, then trace the preprocessing used before the model loads each dataset. Document the actual transformations and the differences that explain why the CDS data does not match; no specific files or tests are named in the issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data, machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.