huggingface / huggingface/diffusers

Support MV-Adapter for multi-view generation

Open
#10,147 1 comment 2 reactions 0 assignees View on GitHub
contributions-welcome New pipeline/model
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

### Model/Pipeline/Scheduler description

[MV-Adapter](https://huanngzh.github.io/MV-Adapter-Page/) is a creative productivity tool that seamlessly transfer text-to-image models to multi-view generators.

Highlights:
- generate 768x768 multi-view images
- work well with personalized models, LCM, ControlNet
- support text or image to multi-view (reconstruct 3D thereafter), or with geometry guidance for 3D texture generation
- arbitrary view generation

Btw, I can help implement it in `diffusers`. But I am not sure whether it should be implemented in the `diffusers` kernel like `t2i_adapter` and `ip_adapter`, or in community pipelines.

### Open source status

- [X] The model implementation is available.
- [X] The model weights are available (Only relevant if addition is not a scheduler).

### Provide useful links for the implementation

Official implementation: https://github.com/huanngzh/MV-Adapter
Model weights: https://huggingface.co/huanngzh/mv-adapter

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.