huggingface / huggingface/diffusers

Dream 7B

Offen
#12,017 2 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
stale
Vorherrschende Sprache
Python
Sterne
34.5k
Forks
7.3k
Ø Merge
3 T. 3 Std.
Gemergte PRs (30 T.)
91

Beschreibung

### Model/Pipeline/Scheduler description

https://hkunlp.github.io/blog/2025/dream/

> In short, Dream 7B:
>
> - consistently outperforms existing diffusion language models by a large margin;
> - matches or exceeds top-tier Autoregressive (AR) language models of similar size on the general, math, and coding > abilities;
> - demonstrates strong planning ability and inference flexibility that naturally benefits from the diffusion modeling.

Basically a new SotA diffusion-based LLM. It would be great to introduce LLMs to the library's roster.

### Open source status

- [x] The model implementation is available.
- [x] The model weights are available (Only relevant if addition is not a scheduler).

### Provide useful links for the implementation

**Team**: Jiacheng Ye*, Zhihui Xie*, Lin Zheng*, Jiahui Gao*, Zirui Wu, Xin Jiang, Zhenguo Li, and Lingpeng Kong.
**Affiliations**: The University of Hong Kong, Huawei Noah’s Ark Lab

[Base HF Link](https://huggingface.co/Dream-org/Dream-v0-Base-7B)
[Instruction-tuned HF Link](https://huggingface.co/Dream-org/Dream-v0-Instruct-7B)
[Codebase](https://github.com/HKUNLP/Dream)

Beitragsleitfaden

Beitragsleitfaden öffnen

Rechercherichtung

Start with the linked Dream codebase and the Base and Instruction-tuned Hugging Face model pages to understand the implementation and available weights. Done means the Dream 7B models are introduced to the diffusers library with their documented usage supported.

Vom Indexierungsmodell aus dem Issue-Text verfasst.

Bewertung

Tech-Stack
python, pytorch
Bereich
machine-learning
Issue-Typ
Feature
Schwierigkeit
4/5
Geschätzter Aufwand
3-5 Tage
Aktivitätsstatus
Veraltet
Klarheit
Größtenteils klar
Anfängerfreundlichkeit
35/100

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.