cncf / cncf/toc

[Initiative]: Cloud Native AI Sustainability Papers

Open
#1,675 10 comments 1 reaction 2 assignees Claimed by @xing-yang View on GitHub
init/in-progress kind/initiative tag/infrastructure tag/operational-resilience toc toc/initiative/AI
Dominant language
HTML
Stars
1.9k
Forks
724
Avg merge
6d 12h
Merged PRs (30d)
4

Description

### Name

Cloud Native AI & Sustainability

### Short description

Two white papers for the AI sustainability

### Responsible group

TOC

### Does the initiative belong to a subproject?

Yes

### Subproject name

Cloud Native AI Working Group

### Primary contact

@zanetworker

### Additional contacts

@raravena80

### Initiative description

Paper 1: The paper aims to provide a framework and recommendations for building and managing AI systems with sustainability in mind, emphasizing resource optimization and reducing the environmental footprint.

Paper 2: The paper discusses the challenges and opportunities for making Generative AI more sustainable in cloud-native systems. It highlights the high energy consumption of AI training and inference, issues like inefficient GPU usage and data management, and proposes strategies for optimization. Key areas of focus include energy tracking, power capping, efficient resource scheduling, and the use of tools like Kepler, Kueue, and KEDA to manage AI workloads more sustainably.

Original issue: https://github.com/cncf/tag-runtime/issues/168

Source: https://docs.google.com/document/d/1tNfR5yxnqfu9fduEb3108oBGXQ6spyRzA6cBTs9zbnQ/edit?tab=t.fwj647zi37u1#heading=h.a2csx0fpflu3

### Deliverable(s) or exit criteria

Final draft versions for both papers to be handed off to the CNCF publishing staff.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.