aws / aws/containers-roadmap

[EKS] [NEURON][request]: add support for k8 neuron scheduler extention

Open
#1,735 1 comment 0 reactions 0 assignees View on GitHub
EKS Proposed
Dominant language
Shell
Stars
5.4k
Forks
334
PR merge metrics
No merged PRs in 30d

Description

### Community Note

* Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the community and maintainers prioritize this request
* Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
* If you are interested in working on this issue or have submitted a pull request, please leave a comment

**Tell us about your request**
For the inferentia nodes it supports the k8s scheduler as described [here](https://awsdocs-neuron.readthedocs-hosted.com/en/latest/neuron-deploy/tutorials/k8s-neuron-scheduler.html). This currently is not supported in EKS and we want to add that support.

**Which service(s) is this request for?**
EKS

**Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard?**
When the POD is scheduled in the inferentia node there is a requirement to have contiguous neuron devices to be available to the container running in the POD. The neuron scheduler extension has added that support and without this if more than 1 devices is requested then non contiguous devices will be made available to container and the neuron runtime will fail.

**Are you currently working around this issue?**
No workaround

**Additional context**

**Attachments**

Contributor guide

Open the contributing guide

Research direction

No repository files or tests are identified in the issue. Start with the linked AWS Neuron Kubernetes scheduler documentation and the EKS scope described here; clarify the integration requirements and validation needed for contiguous Neuron device allocation. Done should mean the requested scheduler support is available in EKS and the stated pod scheduling failure is addressed.

Written by the indexing model from the issue text.

Assessment

Tech stack
kubernetes
Domain
cloud, infrastructure
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.