[EKS] [request]: Provide Nvidia Driver installer on general AMI to replace GPU AMI
- Dominant language
- Shell
- Stars
- 5.4k
- Forks
- 334
- PR merge metrics
- No merged PRs in 30d
Description
**Tell us about your request**
What do you want us to build?
A Nvidia Driver installer for EKS-Optimized Linux AMI.
**Which service(s) is this request for?**
EKS
**Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard?**
What outcome are you trying to achieve, ultimately, and why is it hard/impossible to do right now? What is the impact of not having this problem solved? The more details you can provide, the better we'll be able to understand and solve the problem.
EKS maintains `Amazon EKS-Optimized Linux AMI` and `Amazon EKS-Optimized AMI with GPU Support`. GPU AMI adds extra nvidia-docker and nvidia driver on top of Linux AMI.
Technically, we can install driver and cuda (if needed) separately on every kubernetes node using Daemonset. There's no need to build separate AMI for few reasons
1. Reduce number of AMIs
2. Decouple Nvidia driver upgrade and AMI release
**Are you currently working around this issue?**
How are you currently solving this problem?
**Additional context**
Nvidia also release GPU Operator here https://devblogs.nvidia.com/nvidia-gpu-operator-simplifying-gpu-management-in-kubernetes/. It's even better since user doesn't even need to install Nvidia driver. This is a very young project and we may can go this way eventually. More investigation needed.
**Attachments**
If you think you might have additional information that you'd like to include via an attachment, please do - we'll take a look. (Remember to remove any personally-identifiable information.)
Contributor guide
Research direction
Start by comparing the EKS-Optimized Linux AMI with the GPU Support AMI and reviewing the proposed DaemonSet installation approach. Investigate the linked NVIDIA GPU Operator as an alternative, then determine the installer’s scope and compatibility requirements. Done means a supported driver installation path can replace the separate GPU AMI.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, kubernetes
- Domain
- cloud, devops, infrastructure
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100