aws / aws/containers-roadmap

[EKS] [request]: Provide Nvidia Driver installer on general AMI to replace GPU AMI

Open
#549 10 comments 11 reactions 0 assignees View on GitHub
EKS Proposed
Dominant language
Shell
Stars
5.4k
Forks
334
PR merge metrics
No merged PRs in 30d

Description

**Tell us about your request**
What do you want us to build?
A Nvidia Driver installer for EKS-Optimized Linux AMI.

**Which service(s) is this request for?**
EKS

**Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard?**
What outcome are you trying to achieve, ultimately, and why is it hard/impossible to do right now? What is the impact of not having this problem solved? The more details you can provide, the better we'll be able to understand and solve the problem.

EKS maintains `Amazon EKS-Optimized Linux AMI` and `Amazon EKS-Optimized AMI with GPU Support`. GPU AMI adds extra nvidia-docker and nvidia driver on top of Linux AMI.
Technically, we can install driver and cuda (if needed) separately on every kubernetes node using Daemonset. There's no need to build separate AMI for few reasons

1. Reduce number of AMIs
2. Decouple Nvidia driver upgrade and AMI release

**Are you currently working around this issue?**
How are you currently solving this problem?

**Additional context**
Nvidia also release GPU Operator here https://devblogs.nvidia.com/nvidia-gpu-operator-simplifying-gpu-management-in-kubernetes/. It's even better since user doesn't even need to install Nvidia driver. This is a very young project and we may can go this way eventually. More investigation needed.

**Attachments**
If you think you might have additional information that you'd like to include via an attachment, please do - we'll take a look. (Remember to remove any personally-identifiable information.)

Contributor guide

Open the contributing guide

Research direction

Start by comparing the EKS-Optimized Linux AMI with the GPU Support AMI and reviewing the proposed DaemonSet installation approach. Investigate the linked NVIDIA GPU Operator as an alternative, then determine the installer’s scope and compatibility requirements. Done means a supported driver installation path can replace the separate GPU AMI.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, kubernetes
Domain
cloud, devops, infrastructure
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.