microsoft / microsoft/aurora

Adding Aurora to WeatherBench

Open
#54 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
1k
Forks
174
PR merge metrics
No merged PRs in 30d

Description

Hi,

great work on the paper and also publishing the inference code. As you might know I am running the WeatherBench benchmark: https://sites.research.google/weatherbench/

I am currently in the process of updating WeatherBench with additional models and also updating to 2022. I think it would be great to have Aurora on there as well. If I had unlimited time, I would simply run your inference pipeline and save the data but unfortunately this isn't the case. So I wanted to ask whether there is appetite from your side to work together. Specifically, what I would need is the model output stored for 2022 (since I believe 2020 is part of your training?) for all 00/12 initializations from ERA5. The format isn't that important. Converting to the WB-standard Zarr format is something we can take on.

It would be awesome to also have the 0.1 deg HRES version but I believe that is trained up to incl. 2022 and, for the moment, 2022 is the most recent year we are using in WB.

Please let me know if you have any questions.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the inference pipeline and determine how to run Aurora on ERA5 inputs for every 00/12 initialization in 2022. Done means producing the requested 2022 model outputs and making them available to the WeatherBench maintainers in an agreed format; the issue notes that conversion to WeatherBench's Zarr format can be handled separately.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.