vipshop/cache-dit

View on GitHub

A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for DiTs.

Stars: 1.3k
Forks: 88
Open beginner issues: 0
Indexed issues: 84
Avg merge: 1d 4h
Merged PRs (30d): 14

Dominant language: Python
License: Apache-2.0
Last GitHub push: Sep 18, 2026
Latest indexed: Sep 20, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue

Beginner friendly Everything

Open All

84 open issues indexed

[RFC] Cache-DiT v1.6.0 Roadmap Open

vipshop/cache-dit#1070 · 1 assignee · Opened Jun 26, 2026
[RFC] Partial Programmable Cache API Open

vipshop/cache-dit#1054 · 1 assignee · Opened Jun 15, 2026
links broken for developer guide Open

bug documentation

vipshop/cache-dit#972 · 1 assignee · Opened Apr 12, 2026
Use torch.svd_lowrank for faster svd decompose Open

enhancement performance

vipshop/cache-dit#965 · 1 assignee · Opened Apr 9, 2026
Use gesvd solver for SVDQuant Open

enhancement performance

vipshop/cache-dit#964 · 1 assignee · Opened Apr 9, 2026
Support SVDQuant kernels and PTQ workflows in Cache-DiT Open

feature P0

vipshop/cache-dit#936 · 1 assignee · Opened Mar 31, 2026
Request support for FLUX.2-Klein-KV Open

feature P0

vipshop/cache-dit#875 · 1 assignee · Opened Mar 17, 2026
Support Timestep level caching? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

vipshop/cache-dit#840 · 1 comment · Opened Mar 9, 2026
Support multi sub cp_plan for context parallel Open

vipshop/cache-dit#839 · 1 assignee · Opened Mar 9, 2026
有支持cfg并行的计划吗 Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

vipshop/cache-dit#818 · 1 comment · Opened Mar 2, 2026
residual的泰勒展开和foca Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

vipshop/cache-dit#801 · 3 comments · Opened Feb 25, 2026
About LTX2 infrence Open

Difficulty 1/5 Under an hour Newbie friendliness 20/100

vipshop/cache-dit#798 · 2 comments · Opened Feb 24, 2026
amd gpu doesn't work normally Open

Difficulty 4/5 3-5 days Newbie friendliness 32/100

vipshop/cache-dit#793 · 1 comment · Opened Feb 7, 2026
Flux 2 dev, tp, mutated outputs Open

vipshop/cache-dit#791 · 2 comments · 1 assignee · Opened Feb 6, 2026
torchrun --nproc_per_node=8 generate.py wan2.2_i2v --parallel ulysses_tp --ulysses-anything --num-frames 81 --model-path /sse_ard/pretrained_models/Wan2.2-I2V-A14B-Diffusers --cache --num_inference_steps 2 --track-memory Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

vipshop/cache-dit#784 · 1 comment · Opened Feb 4, 2026
qwen-image-edit 2511 low quanlity Open

vipshop/cache-dit#741 · 1 comment · 1 assignee · Opened Jan 21, 2026
[RFC] Supports MindIE SD Open

enhancement feature

vipshop/cache-dit#733 · 2 reactions · 1 assignee · Opened Jan 20, 2026
使用cache_dit给 LTX-2图生视频加速推理时，遇到了diffusers版本兼容性的问题，我尝试了0.36.0和0.37.0都不行 Open

vipshop/cache-dit#732 · 9 comments · 1 assignee · Opened Jan 20, 2026
Required latency benchmark for H100/H800 Open

vipshop/cache-dit#704 · 1 comment · 2 assignees · Opened Jan 15, 2026
现在的版本是彻底的抛弃了MPS支持 Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

vipshop/cache-dit#657 · 1 comment · Opened Jan 8, 2026
blurry output while using Qwen-Image-Edit-2509 with ulysses + flash attn backend Open

bug

vipshop/cache-dit#632 · 1 comment · 1 assignee · Opened Dec 30, 2025
Request ControlNet Parallelism for Qwen-Image-ControlNet Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

vipshop/cache-dit#613 · Opened Dec 25, 2025
🔥🔥🔥 4x speedup for Z-Image-ControlNet Open

good first issue

Difficulty 5/5 Over a week Newbie friendliness 25/100

vipshop/cache-dit#611 · 2 reactions · Opened Dec 25, 2025
[Feature] vLLM-Omni Bagel support but don't know how to use cache-dit, I need your help🙏 Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

vipshop/cache-dit#598 · 9 comments · Opened Dec 22, 2025
Hi, are there any plan to support DiCache? Open

vipshop/cache-dit#595 · 2 comments · 3 reactions · 1 assignee · Opened Dec 20, 2025
FA3 attention backend import error while FA3 not available Open

bug

vipshop/cache-dit#592 · 1 assignee · Opened Dec 19, 2025
[PR Welcome] Request support for Z-Image ControlNet Open

feature

vipshop/cache-dit#585 · 1 assignee · Opened Dec 18, 2025
Request support for Wan2.2 VACE Open

vipshop/cache-dit#584 · 1 assignee · Opened Dec 18, 2025
Request context parallelism support for Ovis-Image Open

vipshop/cache-dit#561 · 1 assignee · Opened Dec 12, 2025
compile error while using UAA FP8 Open

bug

vipshop/cache-dit#513 · 1 assignee · Opened Dec 2, 2025
Assertion error when supporting non-diffusers' models. Open

vipshop/cache-dit#511 · 4 comments · 1 assignee · Opened Dec 2, 2025
Request default compute masks for SCM Open

vipshop/cache-dit#510 · 1 assignee · Opened Dec 2, 2025
Async Ulysses for Z-Image is not faster than Ulysses while using torch.compile Open

vipshop/cache-dit#506 · 1 assignee · Opened Dec 1, 2025
Z-Image using Ulysses with DBCache FnB0 crash Open

bug

vipshop/cache-dit#498 · 1 comment · 1 assignee · Opened Nov 28, 2025
Request support for Z-Image Open

enhancement feature

vipshop/cache-dit#493 · 3 assignees · Opened Nov 28, 2025
about compile for QwenImageEditPlus Open

question

vipshop/cache-dit#488 · 3 comments · 1 assignee · Opened Nov 27, 2025
qwen_image_controlnet_inpaint 使用cache加速后controlnet失效 Open

vipshop/cache-dit#482 · 4 comments · 1 assignee · Opened Nov 26, 2025
Didn't take effect when used for qwen-image-edit-2509(which is edit plus version) Open

bug

vipshop/cache-dit#481 · 1 comment · 1 assignee · Opened Nov 26, 2025
[Feature] Request support for FLUX-2 ! Open

feature

vipshop/cache-dit#479 · 2 assignees · Opened Nov 26, 2025
GTX 5090 qwen_image tp4 bug Open

vipshop/cache-dit#460 · 1 assignee · Opened Nov 20, 2025
[bug] Context Parallelism Open

bug

vipshop/cache-dit#457 · 11 comments · 1 assignee · Opened Nov 19, 2025
[feat] support piflow models Tensor Parallelism Open

feature

vipshop/cache-dit#438 · 1 comment · 2 assignees · Opened Nov 17, 2025
request support Kandinsky5 context parallel Open

vipshop/cache-dit#427 · 1 assignee · Opened Nov 13, 2025
[FEATURE] WAN* VACE context parallel support Open

vipshop/cache-dit#413 · 1 assignee · Opened Nov 12, 2025
[bug] The tensor parallelism is slow and the memory of a single card has not been reduced. Open

vipshop/cache-dit#403 · 44 comments · 1 assignee · Opened Nov 11, 2025
[FEATURE] WAN* VACE models support Open

vipshop/cache-dit#401 · 2 comments · 1 assignee · Opened Nov 8, 2025
Request Context Parallel support for hyimage and hyvideo Open

vipshop/cache-dit#380 · 1 assignee · Opened Nov 4, 2025
Any plans to support Wan2.2-animate? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

vipshop/cache-dit#368 · 2 comments · Opened Nov 3, 2025
Request Qwen-Image-Lightning parallel infer examples Open

vipshop/cache-dit#367 · 1 assignee · Opened Nov 3, 2025
raise error while using context parallel and cache for wan 2.2 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

vipshop/cache-dit#360 · 2 comments · Opened Nov 1, 2025

vipshop/cache-dit

Get new issues in your inbox