huggingface / huggingface/diffusers

Dream 7B

Open
#12,017 2 comments 0 reactions 0 assignees View on GitHub
stale
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

### Model/Pipeline/Scheduler description

https://hkunlp.github.io/blog/2025/dream/

> In short, Dream 7B:
>
> - consistently outperforms existing diffusion language models by a large margin;
> - matches or exceeds top-tier Autoregressive (AR) language models of similar size on the general, math, and coding > abilities;
> - demonstrates strong planning ability and inference flexibility that naturally benefits from the diffusion modeling.

Basically a new SotA diffusion-based LLM. It would be great to introduce LLMs to the library's roster.

### Open source status

- [x] The model implementation is available.
- [x] The model weights are available (Only relevant if addition is not a scheduler).

### Provide useful links for the implementation

**Team**: Jiacheng Ye*, Zhihui Xie*, Lin Zheng*, Jiahui Gao*, Zirui Wu, Xin Jiang, Zhenguo Li, and Lingpeng Kong.
**Affiliations**: The University of Hong Kong, Huawei Noah’s Ark Lab

[Base HF Link](https://huggingface.co/Dream-org/Dream-v0-Base-7B)
[Instruction-tuned HF Link](https://huggingface.co/Dream-org/Dream-v0-Instruct-7B)
[Codebase](https://github.com/HKUNLP/Dream)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.