Plans for supporting Qwen3-VL or Qwen3.5?
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 305
- Forks
- 24
- PR merge metrics
- No merged PRs in 30d
Description
Hi, great work on AutoGaze! The results on NVILA are impressive.
I'm wondering if there are any plans to extend AutoGaze support to the Qwen3-VL or Qwen3.5 model families? Given their strong performance on video understanding benchmarks and growing adoption in the community, it would be really valuable to see AutoGaze integrated with them.
Specifically:
- Qwen3-VL: Uses a different ViT architecture (ViT-600M with native dynamic resolution) and a distinct visual token compression scheme (spatial merge). Curious whether AutoGaze's patch selection can be adapted to work with their vision encoder.
- Qwen3.5: Builds on Qwen3-VL with further improvements. Same question applies.
The main architectural differences I see compared to NVILA:
- Qwen uses
SigLIP-based ViT with 2D-RoPE instead of InternViT - Spatial merge (2×2 → 1 token) as the default compression, vs. NVILA's tile-based approach
- Different positional encoding scheme for video frames
Would love to hear if this is on the roadmap or if there are any known blockers. Happy to help with integration/testing if there's interest!
Thanks.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing AutoGaze's existing NVILA integration, then compare its patch selection and video-frame handling with the Qwen3-VL architecture described here. Determine whether the ViT, spatial merge, and positional encoding differences allow adaptation; done means a supported Qwen3-VL or Qwen3.5 integration with validation against relevant video understanding behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- computer-vision, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100