Comfy-Org / Comfy-Org/ComfyUI

Separate deployment of front-end and back-end

Open
#8,701 3 comments 1 reaction 0 assignees View on GitHub
Feature
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 6h
Merged PRs (30d)
155

Description

### Feature Idea

Problem: One major challenge in using ComfyUI is the issue of resource allocation.

Background: We have a large GPU server cluster and use Kubernetes for container scheduling. We provide each UI colleague with a ComfyUI interface and allow users to upload models and workflows.

1. Repeatedly uploaded models lead to high storage pressure and increased costs.

2. If a colleague's requested comfyui node is rarely used and they are unsure whether to continue using it, it will result in the GPU being idle and the utilization rate failing to reach the expected level. This in turn leads to an increase in costs.

Desired: It is hoped that the front-end page and the algorithm logic for handling front-end requests (including the programs that call computing power) can be separated. This way, the model files can be managed uniformly. If colleagues A and B both apply for comfyui, I only need to deploy one front-end container for each of them. If the computing power is insufficient, I can increase the number of replicas of the back-end computing power. If other colleagues have other model requirements, I can upload the models they need. This achieves centralized management and greatly improves the utilization rate of computing power nodes.

[ Front-end page & workflow & custom nodes ] --> [ Back-end computing power ]

### Existing Solutions

None

### Other

We all agree that ComfyUI is an extremely perfect project. As time goes by and with the advancement of technology, it will become even more perfect.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.