kubeflow / kubeflow/trainer

KEP-3562: [OptimizationJob] Implement Shared Initializer for state restoration

Open
#3,858 7 comments 0 reactions 1 assignee Claimed by @Haseebx162006 View on GitHub
area/hpo kind/feature kind/plan-kep
Dominant language
Go
Stars
2.2k
Forks
1.1k
Avg merge
3d 22h
Merged PRs (30d)
39

Description

### What you would like to be added?

Context:
In Phase 2 of [KEP-3562](https://github.com/kubeflow/trainer/pull/3565), OptimizationJob aims to support warm-starting experiments and restoring state from previous runs.

Problem:
Currently, starting a new optimization experiment requires re-evaluating all baseline parameters, even if similar historical jobs exist.

Future Goals:

- Introduce a Shared Initializer component to load pre-existing trial history or pre-trained weights.
- Allow OptimizationJob to restore state directly into the Optuna suggestion container upon startup.

We have an existing KEP for the Shared Initializer : https://github.com/kubeflow/trainer/pull/3311

Relates to KEP-3562 Master Tracking [Issue](https://github.com/kubeflow/trainer/issues/3562).

### Why is this needed?

A Shared Initializer enables warm-starting complex tuning jobs, saving significant time and compute cost when iteratively tuning large models.

### Love this feature?

Give it a 👍 We prioritize the features with most 👍

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.