kubeflow / kubeflow/trainer

KEP-2839: Kubeflow Dynamic LLM Trainer Framework

Open
#2,839 42 comments 5 reactions 1 assignee Claimed by @YassinNouh21 View on GitHub
good first issue help wanted kind/feature kind/plan-kep
Dominant language
Go
Stars
2.2k
Forks
1.1k
Avg merge
3d 22h
Merged PRs (30d)
39

Description

### What you would like to be added?

I would like to add Kubeflow Dynamic LLM Trainer Framework to:

1. Streamline LLM Fine-tuning on Kubernetes with a simple yet efficient Python SDK
2. Allow dynamic and extensible registration of popular post-training frameworks
3. Make it possible for day0&day1 model support

Google Doc: http://bit.ly/4nyrQS8 (work in progress)

Upstream KEP: https://github.com/kubeflow/trainer/issues/2401

Appreciate your feedbacks! @kubeflow/kubeflow-trainer-team @kubeflow/kubeflow-sdk-team @deepanker13 @saileshd1402 @seanlaii @helenxie-bit @varshaprasad96 @franciscojavierarceo @thesuperzapper @rimolive @juliusvonkohout @jbottum @varodrig @Doris-xm

### Why is this needed?

Coming from https://github.com/kubeflow/trainer/issues/2752, we decided to adopt the plan 3 after several rounds of discussions.

### Love this feature?

Give it a 👍 We prioritize the features with most 👍

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.