Climate-REF / Climate-REF/climate-ref

Make it possible to use the REF for monitoring model runs

Open
#299 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
26
Forks
14
Avg merge
1d 10h
Merged PRs (30d)
36

Description

## The motivation

There is an interest in using the REF for monitoring model runs https://github.com/ESMValGroup/Community/discussions/215#discussioncomment-12969238 and it seems quite suitable for that.

## The proposed solution

In order to make this work also with data that has not been CMORized yet, it should be easy to add custom data sources. It should be possible to do this without modifying the climate-ref, climate-ref-core, and other infrastructure packages. We would also need a how-to describing how to do this.

An HPC executor #142 would be very useful for this task too.

## Alternatives

Everyone writes their own scripts to:
1) see what data is available
2) generate ESMValTool recipes based on that
3) run those recipes on HPC

This is not very attractive because it duplicates effort.

## Additional context

Contributor guide

Open the contributing guide

Research direction

Start by reading this issue, the linked Community discussion, and issue #142 about an HPC executor. The payload names no files, tests, or entry points, so the first task is to define the custom data-source boundary and how monitoring runs should use it without modifying the infrastructure packages. Done should include a documented how-to and an agreed implementation scope.

Written by the indexing model from the issue text.

Assessment

Tech stack
hpc, python
Domain
data, observability-sre
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.