huggingface / huggingface/diffusers

DDIB: Dual Diffusion Implicit Bridges for Image to Image Translation

Open
#6,662 8 comments 1 reaction 0 assignees View on GitHub
contributions-welcome stale
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

**Is your feature request related to a problem? Please describe.**
Common image translation methods typically depend on joint training using data from both the source and target domains. However, [DDIB](https://suxuann.github.io/ddib/) addresses this challenge by independently training diffusion models on each domain, while maintaining a shared latent space across all domains.
![](https://suxuann.github.io/ddib/assets/teaser.png)
The original DDIB code lacks optimization, leading to lengthy processing times. Additionally, unlike diffusers, it presents challenges when attempting to integrate with other pre-trained models or schedulers.

**Describe the solution you'd like.**
An implementation of DDIB with diffusers that can be run with HF accelerate could speed up the operations and will allow to work more easily with other implementations of models and schedulers on diffusers.

**Describe alternatives you've considered.**
Tried to execute the original code but is too tedious.

**Additional context.**

Paper: https://openreview.net/forum?id=5HLoTvVGDe
Github: https://github.com/suxuann/ddib
Project Page: https://suxuann.github.io/ddib/

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.