MeteoSwiss / MeteoSwiss/evalml

Adding new variables breaks inference

Open
#129 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
11
Forks
0
Avg merge
1d 21h
Merged PRs (30d)
5

Description

Whenever we add new inputs or outputs to our models, there is a high chance that we break inference because some components of our inference pipeline (namely the metadata patches and the GRIB templates) are hardcoded with a limited set of variables. This forces us to merge hotfixes such as #128, which is not ideal.

We should:

* change the GRIB templating approach so that we don't need to specify the list of params
* create variables metadata patches starting from the anemoi datasets used for training (the current patches were derived from some checkpoints), which contain all the possible variables we could need in inference

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing the inference pipeline's GRIB templates and metadata patches, then inspect the anemoi datasets used for training. Confirm how the current hardcoded variable lists are derived and compare them with the datasets' available variables. Done means new model inputs and outputs no longer require manual parameter-list updates or hotfix metadata patches.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.