Comfy-Org / Comfy-Org/ComfyUI

comfyui --benchmark option

Open
#10,483 14 comments 0 reactions 0 assignees View on GitHub
Feature
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 7h
Merged PRs (30d)
158

Description

### Feature Idea

During the discussion of #10302 it would be useful if we have a standard way to benchmark performance of various usages.

Could include:
* vae encode/decode speed (for popular base model(s))
* ksampler speed (for popular base model(s))
* Upscale by model speed

Could start with sdxl & wan, Ultrasharp upscaling.

Perhaps run comfy with `--benchmark [scenarios]` and it runs the scenarios (if the models are available on the filesystem) outputting a text report.

Would be a useful tool for just trying all the different options available locally to see what performs best in addition to comparing perf across platforms & setups.

### Existing Solutions

Adhoc testing by running workflows and checking the speed

### Other

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.