google / google/tunix

Qwen3-VL

Open
#1,063 0 comments 0 reactions 0 assignees View on GitHub
type:feature/enhancement
Dominant language
Python
Stars
2.5k
Forks
345
Avg merge
1d 7h
Merged PRs (30d)
240

Description

**Is your feature request related to a problem? Please describe.**

Currently, Tunix supports text-only Qwen3, but not multimodal Qwen3-VL. This makes it harder to compare performance of different VLMs on vision-language tasks.

**Describe the solution you'd like**

According to the [technical report](https://arxiv.org/pdf/2511.21631), Qwen3-VL adopts a three-module architecture comprising a vision encoder, an MLP-based vision–language merger, and a large language model (LLM). The vision encoder is SigLIP2, which we already have as WIP in #511.

It's also worth to mention:

* Interleaved MRoPE, which we don't seem to support yet
* DeepStack for the vision-language merger, which is a bit more complicated than what we gave for Gemma 3
* Video timestamp

**Additional context**

A couple of design questions:

1. Should we wait for #511 to be merged or start the work on Qwen3-VL in parallel? Calling @abheesht17 for an opinion.
2. Should we extend (text-only) Qwen3 or create a totally new model? I'm not sure it will be easy to integrate DeepStack without changing the way of the text-only version.

**Checklist**

- [x] I have searched the existing issues for similar feature requests.
- [x] This is not a support question (please use the "bug template" for that).

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.