MetOffice / MetOffice/data_science_cop
Create example of running on European Weather Cloud GPUs
- Dominant language
- Jupyter Notebook
- Stars
- 26
- Forks
- 10
- Avg merge
- 7d 16m
- Merged PRs (30d)
- 1
Description
Met Office has an allocation of compute on the European Weather Cloud (EWC) which includes GPU nodes. It would be useful to explore running MLint stuff on there, specifically doing experiments using ECWMF as initial conditions (e.g. IFS HRES analysis fields) as the data will be much faster to access.
To get access to the EWC, you need to create an account. This is done through the Met Office representative, who is Steve Grant at email comp-rep@metoffice.gov.uk
- https://europeanweather.cloud/get-access
- https://www.ecmwf.int/en/about/contact-us/computing-representatives
- https://confluence.ecmwf.int/display/EWCLOUDKB/European+Weather+Cloud+Knowledge+Base
### Definiition of done
- [ ] Get acccount on EWC
- [ ] Get [ML Weather tutorial](https://github.com/informatics-lab/ml_weather_tutorial/) running on EWC
- [ ] Create a "Getting started" guide for MO staff to gain access and use EWC for training an ML model
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the linked ML Weather tutorial and the European Weather Cloud access and knowledge-base links. Request EWC access through the listed Met Office representative, then run the tutorial on EWC using ECMWF initial conditions. Done means the tutorial runs there and a Getting Started guide explains access and training an ML model for Met Office staff.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- jupyter-notebook, machine-learning, python
- Domain
- cloud, documentation, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 32/100