climate-analytics-lab / climate-analytics-lab/ClimateBench2

Infrastructure: CRPS and probabilistic scoring framework

Open
#97 0 comments 0 reactions 0 assignees View on GitHub
infrastructure
Dominant language
Shell
Stars
1
Forks
1
PR merge metrics
No merged PRs in 30d

Description

## Description
Implement the core probabilistic scoring framework used across Tiers II and III.

## Components
- **CRPS** (Continuous Ranked Probability Score) for ensemble evaluation
- **Spread–skill ratio** for ensemble calibration
- **NRMSE** for deterministic diagnostics
- **Spatial correlation** for pattern evaluation
- Consider **spherical convolutional Wasserstein distance** (Garrett et al., 2024) for future versions

## Notes
- Must handle different ensemble sizes gracefully
- Adapted for larger observational uncertainties in Tier III (proxy data)
- Computational cost (wall-clock time, peak memory) reported but not scored

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.