microsoft / microsoft/onnxruntime-genai

How to select NPU instead of GPU on Intel laptop?

Open
#1,029 0 comments 0 reactions 0 assignees View on GitHub
ep:DML
Dominant language
C++
Stars
1.1k
Forks
354
Avg merge
2d 16h
Merged PRs (30d)
85

Description

Where could I find a code sample showing how to run genai on NPU instead of GPU using `DmlExecutionProvider` in Python?

Conda environment:
```yaml
name: phi3-onnx-dml
channels:
- conda-forge
- nodefaults
dependencies:
- python=3.12
- vs2015_runtime=14.40.33810
- pip
- pip:
- ipykernel==6.29.5
- numpy==1.26.4
- huggingface-hub[cli]==0.26.2
- onnxruntime-directml==1.20.0
- onnxruntime-genai-directml==0.4.0
```

Contributor guide

No contributing guide indexed for this repository

Research direction

No file, test, or entry point is named. Start by locating the Python usage and DirectML execution-provider documentation related to the supplied onnxruntime-genai-directml environment; done should be a clear code sample showing how to run genai on an Intel NPU instead of the GPU.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.