Comfy-Org / Comfy-Org/ComfyUI

Integration with an externally hosted backend (LocalAI?)

Open
#3,365 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 10h
Merged PRs (30d)
153

Description

Just thinking aloud.

How easy would it be to separate the functionality of the backend and abstract it away to a hosting tool like localai?

I have been investigating methods for consolidating resource requirements for AI tools and one of the topics that I keep hitting on is 'model size' which may become especially important as larger models become available or required to reach certain quality and performance standards.
The thought process is 'if you have 20 artists and they are all using generative tools at about a 5% duty time, currently if they all wanted to use comfyui then they would each have to have a system with enough gpu resources to host the model'.
By externalising the backend to some other system then instead of a 5% duty time for 20 systems you would have a 100% duty time for 1 system. I see that there is some separation between the backend and the frontend but it is hard to tell if the integration into localai is easy without spending considerable time. also making the backend accessible via the internet may require authentication elements that as yet are not in localai ([but are being discussed](https://github.com/mudler/LocalAI/issues/2102))

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.