huggingface / huggingface/diffusers

Add ReNeg: An end-toend method designed to learn improved Negative embeddings (CVPR 2025 Highlight)

Aperta
#11,256 2 commenti 0 reazioni 0 assegnatari Vedi su GitHub
stale
Lingua principale
Python
Stelle
34.5k
Fork
7.3k
Merge medio
3g 3h
PR unite (30g)
91

Descrizione

### **Model/Pipeline/Scheduler description**

[ReNeg] is a reward-guided approach that directly learns Negative embeddings through gradient descent. The negative embedding learned within the same text embedding space exhibits strong generalization capabilities.

For example, using the same CLIP text encoder, the negative embedding learned on SD1.5 can be seamlessly transferred to text-to-image or even text-to-video models such as ControlNet, ZeroScope, and VideoCrafter2, resulting in consistent performance improvements across the board.

![Image](https://github.com/user-attachments/assets/9c5e653e-989c-48bf-bc31-1547513a1362)

### **Open Source Status**

- [x] The model implementation is available.
- [x] The model weights are available (Only relevant if addition is not a scheduler).

### **Provide useful links for the implementation**

Official implementation: https://github.com/AMD-AIG-AIMA/ReNeg

Guida per i contributori

Apri la guida per i contributori

Direzione di ricerca

The payload names no target files or tests. Start by reading the official ReNeg implementation and its model, pipeline, and scheduler entry points; done means integrating the available ReNeg implementation and weights into diffusers while preserving the described transfer to supported text-to-image and text-to-video models.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
python, pytorch
Ambito
machine-learning
Tipo di issue
Funzionalità
Difficoltà
5/5
Tempo stimato
Più di una settimana
Stato di attività
Ferma
Chiarezza
Da chiarire
Idoneità per principianti
35/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.