invoke-ai / invoke-ai/InvokeAI

[enhancement]: Add a queue workers swarm feature.

Open
#7,576 0 comments 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
28.2k
Forks
3k
Avg merge
6d 5h
Merged PRs (30d)
19

Description

### Is there an existing issue for this?

- [x] I have searched the existing issues

### Contact Details

Fl1nt (Discord)

### What should this feature add?

Invoke can be run as individual swarm of headless servers using kubernetes. It would be interesting and super useful to be able for the installer/client to connect to those servers as if they were workers pools.

At first, just be able to add them manually through the Queue interface/api would be nice.
Then be able to just launch a client interface that detect them automatically (doable with the discovery capabilities of k8s) would be awesome as it would allow to get a really small client flavor that remotely connect to the cluster.

### Alternatives

Spawn multiple instances on k8s and then have a custom interface that send requests to those instances API directly.

### Additional Content

Here is quick UI suggestion, it would need a tab for the workers inventory list with labels and filters, but I think you get where I'm heading.
![Image](https://github.com/user-attachments/assets/13c4a6c9-4f2e-4f34-959a-52835af11ad1)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.