huggingface / huggingface/diffusers
Dream 7B
- Dominant language
- Python
- Stars
- 34.5k
- Forks
- 7.3k
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 91
Description
### Model/Pipeline/Scheduler description
https://hkunlp.github.io/blog/2025/dream/
> In short, Dream 7B:
>
> - consistently outperforms existing diffusion language models by a large margin;
> - matches or exceeds top-tier Autoregressive (AR) language models of similar size on the general, math, and coding > abilities;
> - demonstrates strong planning ability and inference flexibility that naturally benefits from the diffusion modeling.
Basically a new SotA diffusion-based LLM. It would be great to introduce LLMs to the library's roster.
### Open source status
- [x] The model implementation is available.
- [x] The model weights are available (Only relevant if addition is not a scheduler).
### Provide useful links for the implementation
**Team**: Jiacheng Ye*, Zhihui Xie*, Lin Zheng*, Jiahui Gao*, Zirui Wu, Xin Jiang, Zhenguo Li, and Lingpeng Kong.
**Affiliations**: The University of Hong Kong, Huawei Noah’s Ark Lab
[Base HF Link](https://huggingface.co/Dream-org/Dream-v0-Base-7B)
[Instruction-tuned HF Link](https://huggingface.co/Dream-org/Dream-v0-Instruct-7B)
[Codebase](https://github.com/HKUNLP/Dream)
Contributor guide
Assessment
This issue has not been assessed yet.