huggingface / huggingface/diffusers

Request to implement FreeScale, a new diffusion scheduler

Open
#10,281 1 comment 0 reactions 0 assignees View on GitHub
consider-for-modular-diffusers stale
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

### Model/Pipeline/Scheduler description

FreeScale is a tuning-free method for higher-resolution visual generation, unlocking the 8k image generation for pre-trained SDXL! Compared to direct inference by SDXL, FreeScale brings negligible additional memory and time costs.

![fig_teaser](https://github.com/user-attachments/assets/3eef38cc-3642-42a7-b5e7-8b32c32ecc77)

![fig_diff8k](https://github.com/user-attachments/assets/8cec7c55-011e-4434-81e3-1e80dd5dd003)

### Open source status

- [X] The model implementation is available.
- [X] The model weights are available (Only relevant if addition is not a scheduler).

### Provide useful links for the implementation

- Project: http://haonanqiu.com/projects/FreeScale.html
- Paper: https://arxiv.org/abs/2412.09626
- Code: https://github.com/ali-vilab/FreeScale
- Hugging Face Demo: https://huggingface.co/spaces/MoonQiu/FreeScale

The code changes of FreeScale are not complicated, but I do not know how to integrate them into diffusers smoothly. If you have questions about FreeScale, please ask me(@arthur-qiu).

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.