microsoft / microsoft/onnxruntime-genai

Lack of requirements for builder.py

Open
#1,759 0 comments 0 reactions 0 assignees View on GitHub
ep:DML
Dominant language
C++
Stars
1.1k
Forks
354
Avg merge
2d 16h
Merged PRs (30d)
85

Description

**Describe the bug**
It is very unclear how to setup a python environment for builder.py as installing onnxruntime-genai-directml is not enough. This used to be included here: https://onnxruntime.ai/docs/genai/howto/build-model.html, but seems this was removed after moving instructions to the README.

**To Reproduce**
- hf auth login --token
- pip install onnxruntime-genai-directml
- python builder.py -m deepseek-ai/DeepSeek-R1-Distill-Llama-8B -p int4 -e dml -o onnx_model_builder\DeepSeek-R1-Distill-Llama-8B_int4_DML_ortgenai -c onnx_model_builder\ortgenai_model_cache --extra_options int4_algo_config=rtn
- missing pypi package errors.

**Expected behavior**
Run without chasing requirements needed for builder.py.

**Desktop:**
- OS: Windows 11
- Browser: Firefox
- Version: 0.9.1

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with builder.py and the README, then reproduce the reported Windows command in a clean Python environment after installing onnxruntime-genai-directml. Compare the missing-package errors with the setup instructions and document the required requirements so the command runs without manual package hunting.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
tooling
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
50/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.