lmstudio-ai / lmstudio-ai/mlx-engine

Image tokens not always included when running Qwen3-VL

Open
#233 14 comments 0 reactions 1 assignee Claimed by @neilmehta24 View on GitHub
bug fixed-in-next-release
Dominant language
Python
Stars
1.2k
Forks
133
Avg merge
21h 6m
Merged PRs (30d)
1

Description

I was interacting with a user in Discord who was trying to run Qwen3-VL and they kept getting this error:

`Error: Error in iterating prediction stream: ValueError: Image features and image tokens do not match: tokens: 0, features 240`

I'm pretty sure this means that their prompt was not including the image tokens for some reason. I confirmed that they had the latest runtime (v0.30.0) and their application was up to date. Interestingly, the user had no issues with Qwen2.5-VL. After some debugging, I asked the user to move their `~/.cache/lm-studio` folder out of their home directory and then reinstall the LM Studio application. This solved the problem and they were able chat with Qwen3-VL.

I'm not sure what was happening or why regenerating the cache folder seemed to work, so I wanted to put this on your radar. Our messages are in the `model-discussion` channel in the Discord server if you want to see more context about what we tried while debugging. Throughout our conversation I was unable to reproduce the error on my end.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.