MetOffice / MetOffice/XBTs_classification

Use scikit-learn pipeline in XBT code.

Open
#55 1 comment 0 reactions 1 assignee View on GitHub

@stevehadd is already working on this.

Since Jul 29, 2020.

libraries pipelines
Dominant language
Jupyter Notebook
Stars
4
Forks
2
PR merge metrics
No merged PRs in 30d

Description

Currently we are manually putting together the pipeline for processing XBT data. Now that the desired pipeline has been decided and described (by the code), it would be good to implement this properly using the scikit-learn pipeline class. As there is some custom processing going on, this will probably involved

https://scikit-learn.org/stable/modules/generated/sklearn.pipeline.Pipeline.html
https://scikit-learn.org/stable/modules/compose.html
https://scikit-learn.org/stable/developers/develop.html?highlight=baseestimator

With this we could encapsulate each step of processing whether custom or using standard scikit-learn object, into a pipeline, which can then be used to feed in to a voting classifier. Steps in the pipeline could include

* select a subset of features (custom)
* select a subset and splits of data (custom)
* hyperparameter tuning (grid search or random) (standard scikit-learn)
* cross validation (outer and inner) (standard scikit-learn, with custom folds)
* calculate metrics (for score function) (custom classes using standard classes)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.