huggingface / huggingface/diffusers

support TextDiffuser pipelines natively in Diffusers

Open
#8,410 5 comments 0 reactions 0 assignees View on GitHub
contributions-welcome stale
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

### Model/Pipeline/Scheduler description

![image](https://github.com/microsoft/unilm/raw/master/textdiffuser/assets/readme_images/introduction.jpg)

TextDiffuser is an open-source framework and pretrained model series for generating unique depth maps that can be used to guide the model for typography.

It not only has open code and weights, but the dataset is also available, containing ~9.7 million typography samples 🤯

### Open source status

- [X] The model implementation is available.
- [X] The model weights are available (Only relevant if addition is not a scheduler).

### Provide useful links for the implementation

Original repository: https://github.com/microsoft/unilm/tree/master/textdiffuser
Follow-up repository: https://github.com/microsoft/unilm/tree/master/textdiffuser-2
Demo video (not mine): https://youtu.be/ApcJ1UyLQB8?t=62 (timestamp)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.