Comfy-Org / Comfy-Org/ComfyUI

[Feature Request] Experiment manager

Open
#3,008 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 7h
Merged PRs (30d)
158

Description

Let's say I conduct a lot of experiments with parameters and generate more than 10,000 images per week.

Currently, there is no easy way to track such a large number of experiments, and many parameters are missing, making it very difficult to reproduce the results and share them with others.

While the workflow.json operates at the workflow level, much vital information is per run and is currently absent.

The proposed solution is to implement an experiment manager to:

1. Track all information of each run.
2. Rerun experiments with the same parameters.
3. Visualize the results of each run.
4. Share experiment runs.
5. Automatically deploy each run to the cloud, etc.

It's kind of like MLflow for machine learning.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.