huggingface / huggingface/diffusers

[Feature Request] Add Implement of 'Kuramoto Orientation Diffusion'

Open
#12,903 1 comment 0 reactions 0 assignees View on GitHub
stale
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

Source code: https://github.com/KingJamesSong/OrientationDiffusion (the official implement use pure `torch`)

This paper introduces a nonlinear score-based generative framework that incorporates stochastic Kuramoto dynamics to model orientation-rich data. By formulating the forward process as synchronization and the reverse process as desynchronization, our method brings biologically inspired inductive biases into the diffusion process. Through wrapped Gaussian transitions and periodicityaware networks, the model naturally captures the geometry of angular data. Experiments show that our approach outperforms conventional baselines on orientation-dense datasets and remains competitive on general image generation tasks. This work highlights the potential of integrating biologically inspired synchronization dynamics as structured priors in generative modeling of orientation-dense data, paving the way for incorporating nonlinear dynamics into generative models.

Image

Governing stochastic differential equations (SDEs) and representative image samples from our globally and locally coupled Kuramoto orientation diffusion models.

Image

[60] Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equations. ICLR, 2021.
[68] Jia Xue, Hang Zhang, and Kristin Dana. Deep texture manifold for ground terrain recognition. In CVPR, 2018.

---
```bibtex
@inproceedings{songKuramotoOrientationDiffusion2025a,
title = {Kuramoto {{Orientation Diffusion Models}}},
booktitle = {{{NeurIPS}}},
author = {Song, Yue and Keller, T. Anderson and Brodjian, Sevan and Miyato, Takeru and Yue, Yisong and Perona, Pietro and Welling, Max},
year = 2025,
url={\url{https://openreview.net/forum?id=dxK2QgEKvz}}
}
```

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the linked official implementation at github.com/KingJamesSong/OrientationDiffusion and the cited Kuramoto Orientation Diffusion paper. Compare its pure PyTorch components with the diffusers repository to determine the required integration surface and validation approach. Done is not defined by the issue; the implementation scope and expected tests need maintainer clarification.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.