cncf / cncf/toc

[Subproject Application]: CNCF Batch & HPC System Initiative

Open
#1,707 2 comments 4 reactions 0 assignees View on GitHub
kind/subproject needs-triage tag/workloads-foundation
Dominant language
HTML
Stars
1.9k
Forks
724
Avg merge
6d 12h
Merged PRs (30d)
4

Description

### Subproject Name

HPC with Kubernetes

### Parent Group

TAG Workloads Foundation

### Mission/Purpose

Innovate with and around Kubernetes to enable running of batch AI/Inference/HPC workloads in the cloud

### Scope

This Subproject will involve improving data-aware scheduling in Kubernetes, benchmarking different workloads with existing and new scheduling mechanisms, and creating well-defined definitions that can be consumed by the HPC and Kubernetes communities.

### Goals and Objectives

We will work on multiple initiatives to make batch-type workloads work more natively in the cloud. These include the following already-started interest groups: data-aware scheduling with API spec, benchmarking AI systems in the cloud, user stories around batch workloads in the cloud, and clear definitions around this space.

### Proposed Leads

Alex Scammon, Marlow Warnicke, and Abhishek Malvankar

### Initial Participants/Contributors

G-Research, SchedMD, IBM Research ....

### Benefits to CNCF

Batch workloads are becoming increasingly important, especially around training and multi-node inference.This group is a cohesive group of people trying to make these work more natively in the cloud.

### Alignment with Parent Group

We handle high-performance workloads and all the projects therein.

### Proposed Communication Channels

_No response_

### Proposed Initial Deliverables (if applicable)

_No response_

### Potential Future Work/Evolution

_No response_

### Sponsoring CNCF Project or TOC Member (if applicable)

_No response_

### Additional Information

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.