kubeflow / kubeflow/trainer

KEP-3562: OptimizationJob CRD for HPO: The Evolution of the Katib Project

Open
#3,562 26 comments 7 reactions 2 assignees Claimed by @aniket2405 View on GitHub
area/api area/gsoc kind/feature kind/plan-kep
Dominant language
Go
Stars
2.2k
Forks
1.1k
Avg merge
3d 22h
Merged PRs (30d)
39

Description

This issue tracks work on adding OptimizationJob CRD support as discussed in https://github.com/kubeflow/sdk/tree/main/docs/proposals/46-hyperparameter-optimization#potential-api-for-optimizationjob-crd that focuses on hyperparameter optimization (HPO) for TrainJobs

It should include -
- CRD specifically for hyperparameter optimization of TrainJobs
- Integration with TrainJob API
- Support for model/dataset initialization shared across trials
- Support push-based metrics collection via SDK
- Integration with SDK's `OptimizerClient` API

## Design Document

https://docs.google.com/document/d/1Y8IJ-UdZ7VCEAlax_xEFbbqEi7EB6SfIX4D7ua-xn4M/edit

cc @andreyvelich @kramaranya

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.