huggingface / huggingface/diffusers

Add Lumina-DiMOO as a pipeline

Open
#12,358 1 comment 0 reactions 0 assignees View on GitHub
stale
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

### Model/Pipeline/Scheduler description

Lumina-DiMOO is a unified multimodal model built on fully discrete diffusion. It supports a wide range of tasks, including text-to-image, image-to-image (editing, subject-driven generation, inpainting), and image understanding. It also outperforms existing open-source multimodal models with stronger results and much higher sampling efficiency. It would be great to have this model in diffusers.

### Open source status

- [x] The model implementation is available.
- [x] The model weights are available (Only relevant if addition is not a scheduler).

### Provide useful links for the implementation

project page: https://synbol.github.io/Lumina-DiMOO
code: https://github.com/Alpha-VLLM/Lumina-DiMOO
model weights: https://huggingface.co/Alpha-VLLM/Lumina-DiMOO

@synbol @ChinChyi

Contributor guide

Open the contributing guide

Research direction

Start by reading the linked Lumina-DiMOO project page and implementation, then inspect the model weights on Hugging Face. Determine how its text-to-image, image-to-image, inpainting, subject-driven generation, and image-understanding tasks map to a diffusers pipeline. Done means Lumina-DiMOO is available in diffusers with the requested model capabilities.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.