MetOffice / MetOffice/data_science_cop

Create example of running on European Weather Cloud GPUs

Open
#43 0 comments 0 reactions 0 assignees View on GitHub
compute tutorial
Dominant language
Jupyter Notebook
Stars
26
Forks
10
Avg merge
7d 16m
Merged PRs (30d)
1

Description

Met Office has an allocation of compute on the European Weather Cloud (EWC) which includes GPU nodes. It would be useful to explore running MLint stuff on there, specifically doing experiments using ECWMF as initial conditions (e.g. IFS HRES analysis fields) as the data will be much faster to access.

To get access to the EWC, you need to create an account. This is done through the Met Office representative, who is Steve Grant at email comp-rep@metoffice.gov.uk

- https://europeanweather.cloud/get-access
- https://www.ecmwf.int/en/about/contact-us/computing-representatives
- https://confluence.ecmwf.int/display/EWCLOUDKB/European+Weather+Cloud+Knowledge+Base
### Definiition of done
- [ ] Get acccount on EWC
- [ ] Get [ML Weather tutorial](https://github.com/informatics-lab/ml_weather_tutorial/) running on EWC
- [ ] Create a "Getting started" guide for MO staff to gain access and use EWC for training an ML model

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the linked ML Weather tutorial and the European Weather Cloud access and knowledge-base links. Request EWC access through the listed Met Office representative, then run the tutorial on EWC using ECMWF initial conditions. Done means the tutorial runs there and a Getting Started guide explains access and training an ML model for Met Office staff.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook, machine-learning, python
Domain
cloud, documentation, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
32/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.