huggingface / huggingface/diffusers

Add VideoDeltaNet-H3 Model

Open
#14,700 13 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

### Model/Pipeline/Scheduler description

VideoDeltaNet (VDN-H3) is a hybrid-attention variant of MiniMax H3 designed for faster video generation with near-lossless quality. It replaces dense video-video attention with a combination of local sliding-window softmax attention and long-range linear attention, while keeping the original H3 backbone largely unchanged.

All weights and training and inference code are available.

### Open source status

- [x] The model implementation is available.
- [x] The model weights are available (Only relevant if addition is not a scheduler).

### Provide useful links for the implementation

Weight: https://huggingface.co/OpenVDN/vdn-minimax-h3
Code: https://github.com/OpenVDN/vdn-minimax-h3
I'm the author :)

Contributor guide

Open the contributing guide

Research direction

Start by reading the model implementation at https://github.com/OpenVDN/vdn-minimax-h3 and reviewing the weights at https://huggingface.co/OpenVDN/vdn-minimax-h3. Then compare the implementation with existing diffusers model, pipeline, and scheduler integrations. Done means VideoDeltaNet-H3 is added to diffusers with its available weights and documented inference support.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.