comfyui --benchmark option
- Dominant language
- Python
- Stars
- 133k
- Forks
- 15.7k
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 158
Description
### Feature Idea
During the discussion of #10302 it would be useful if we have a standard way to benchmark performance of various usages.
Could include:
* vae encode/decode speed (for popular base model(s))
* ksampler speed (for popular base model(s))
* Upscale by model speed
Could start with sdxl & wan, Ultrasharp upscaling.
Perhaps run comfy with `--benchmark [scenarios]` and it runs the scenarios (if the models are available on the filesystem) outputting a text report.
Would be a useful tool for just trying all the different options available locally to see what performs best in addition to comparing perf across platforms & setups.
### Existing Solutions
Adhoc testing by running workflows and checking the speed
### Other
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.