Comfy-Org / Comfy-Org/ComfyUI

Support for ByteDance's Lance Model (Omni Multi-modal)

Open
#13,990 2 comments 5 reactions 0 assignees View on GitHub
Feature
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 7h
Merged PRs (30d)
158

Description

### Feature Idea

With the rise of efficient, multi-modal omni models, there is currently no official support in ComfyUI for unified text, audio, and video generation/understanding within a single compact model.

It would be amazing to have official ComfyUI support (nodes/loaders) for ByteDance's new Lance model.

Repository: [bytedance/Lance](https://github.com/bytedance/Lance)

Hugging Face: [bytedance-research/Lance](https://huggingface.co/bytedance-research/Lance)

Why this would be a great addition:

Efficiency: At only 3B parameters, it is highly accessible for consumer hardware and local running.

Versatility: It natively supports text, audio, and video (both generation and understanding), which opens up massive possibilities for complex, multi-modal ComfyUI workflows.

Thank you to the ComfyUI team for all your incredible hard work and for sharing this amazing tool with the community!

### Existing Solutions

_No response_

### Other

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.