huggingface / huggingface/diffusers

[Feature Request] Add LoRA loading support for HunyuanVideo 1.5

Aperta
#14,420 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub
feature-request lora pipelines
Lingua principale
Python
Stelle
34.5k
Fork
7.3k
Merge medio
3g 3h
PR unite (30g)
91

Descrizione

**What does this feature request propose?**

HunyuanVideo 1.5 was recently added to diffusers with two pipelines:
- `HunyuanVideo15Pipeline` (text-to-video)
- `HunyuanVideo15ImageToVideoPipeline` (image-to-video)

However, neither pipeline has LoRA support. Both classes currently inherit only from `DiffusionPipeline` with no `LoraLoaderMixin`.

HunyuanVideo v1 already has `HunyuanVideoLoraLoaderMixin` covering its pipelines, but that mixin explicitly targets `HunyuanVideoTransformer3DModel`. HunyuanVideo 1.5 uses a distinct `HunyuanVideo15Transformer3DModel`, so it cannot reuse the v1 mixin directly.

**Proposed implementation**

- Add `HunyuanVideo15LoraLoaderMixin` to `src/diffusers/loaders/lora_pipeline.py`, modelled after the existing `HunyuanVideoLoraLoaderMixin` but targeting `HunyuanVideo15Transformer3DModel`
- Wire both `HunyuanVideo15Pipeline` and `HunyuanVideo15ImageToVideoPipeline` to inherit from it
- Export the new mixin from `src/diffusers/loaders/__init__.py`
- Add tests mirroring the existing HunyuanVideo LoRA test coverage

**Why is this needed?**

HunyuanVideo has a large and active fine-tuning community. LoRA training for 1.5 is already happening in tools like ai-toolkit and ComfyUI. Without a standard loader in diffusers, users have no clean path to load those LoRAs through the library.

**Who can review?**
`@sayakpaul` `@DN6` `@yiyixuxu`

**Are you willing to contribute?**
Yes, happy to open a PR if the approach looks reasonable.

Guida per i contributori

Apri la guida per i contributori

Direzione di ricerca

Start with HunyunVideoLoraLoaderMixin in src/diffusers/loaders/lora_pipeline.py and compare the HunyuanVideo 1.5 pipeline classes. Trace the existing HunyuanVideo LoRA tests, then add matching coverage for both pipelines and verify the new mixin is exported from src/diffusers/loaders/__init__.py; done means both pipelines can load HunyuanVideo 1.5 LoRAs through the standard loader.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
python, pytorch
Ambito
machine-learning, testing-qa
Tipo di issue
Funzionalità
Difficoltà
4/5
Tempo stimato
3-5 giorni
Stato di attività
Tranquilla
Chiarezza
Specificata chiaramente
Idoneità per principianti
72/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.