kubeflow / kubeflow/trainer

KEP-3562: [OptimizationJob] Add support for Early Stopping (Pruning), Hyperband, and PBT

Open
#3,802 8 comments 0 reactions 1 assignee Claimed by @saivedant169 View on GitHub
area/hpo kind/feature kind/plan-kep
Dominant language
Go
Stars
2.2k
Forks
1.1k
Avg merge
3d 22h
Merged PRs (30d)
39

Description

### What you would like to be added?

Context:
In [KEP-3562](https://github.com/kubeflow/trainer/pull/3565), Phase 1 focuses on standard search strategies (Random, Grid).

Problem:
Running underperforming trials to full completion wastes compute resources and increases cloud costs.

Future Goals:

- Add `PruneAlgorithms` to the `OptimizationJob` schema (e.g., Hyperband, Population Based Training).

- Implement intermediate trial metric reporting from TrainJob workers back to the controller/Optuna engine.

- Add controller logic to terminate unpromising TrainJobs early.

Relates to KEP-3562 Master Tracking [Issue](https://github.com/kubeflow/trainer/issues/3562).

### Why is this needed?

Early stopping and advanced pruning algorithms save up to 80% of compute resources during hyperparameter searches by stopping poor trials early.

### Love this feature?

Give it a 👍 We prioritize the features with most 👍

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.