vipshop / vipshop/cache-dit

🔥Qwen-Image 4.8x speedup w/ Hybrid Acceleration for low VRAM GPUs

Open
#320 4 comments 0 reactions 1 assignee View on GitHub

@DefTruth is already working on this.

Since Oct 24, 2025.

Dominant language
Python
Stars
1.3k
Forks
88
Avg merge
1d 4h
Merged PRs (30d)
14

Description

We have release a hybrid acceleration example for qwen-image, feel free to take a try (Cache + Context Parallelism + FP8 Weight Only + Torch Compile), for example: (Also check qwen-image-fast)

# Baseline (NVIDIA L20 48GiB, ~120s w/ CPU Offload)
python3 run_qwen_image_cp.py --height 1024 --width 1024

# + (DBCache + TaylorSeer) 
# + Context Parallelism (Ulysses)
# + FP8 Weight Only (not require offload anymore) 
# + Torch Compile (NVIDIA L20x2, ~25s, ~4.8x speedup)
torchrun --nproc_per_node=2 run_qwen_image_cp.py \
         --height 1024 --width 1024 \
         --parallel-type ulysses --quantize \
         --cache --Fn 1 --rdt 0.12 --mcc 2 --taylorseer \
         --compile
  • Baseline: 120s
Image
  • Hybrid Acceleration: 25s
Image

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.