huggingface / huggingface/optimum-intel

Qwen 2.5 VL inference on NPU is not producing any output.

Open
#1,305 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
620
Forks
270
Avg merge
4d 47m
Merged PRs (30d)
25

Description

I have been trying to do inference of Qwen 2.5 VL 7b model on NPU and it is not giving any output.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing Qwen 2.5 VL 7B inference on an NPU and record the model, device, inputs, environment, and any errors or logs. Compare the expected output with the observed lack of output, then document a confirmed cause and a reproducible verification that inference produces output.

Written by the indexing model from the issue text.

Assessment

Domain
ai, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.