microsoft / microsoft/Windows-Containers

NPU Acceleration

Open
#505 11 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

🔖 ADO AI/ML enhancement perf
Dominant language
PowerShell
Stars
551
Forks
76
PR merge metrics
No merged PRs in 30d

Description

Currently, only a subset of devices can be passed through, with GPUs being one of them (albeit limited with only DirectX based frameworks).
With the rise and push of NPU/IPUs built into processors, it would be beneficial to provide NPU acceleration in Windows Containers to be able to containerize our AI/ML workloads.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files, tests, or entry points. Start by identifying the Windows Containers device pass-through implementation and its existing GPU limitations; done means documenting and implementing a defined approach for NPU acceleration in Windows Containers, with coverage for the supported AI/ML workload scenarios.

Written by the indexing model from the issue text.

Assessment

Tech stack
machine-learning
Domain
devops, machine-learning, operating-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.