[RFC]: OpenAI Image Edit API Interface for ComfyUI
- Dominant language
- Python
- Stars
- 133k
- Forks
- 15.7k
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 158
Description
### Feature Idea
Motivation.
While ComfyUI supports local inpainting and OpenAI text-to-image, it lacks a native or well-standardized way to leverage OpenAI's cloud-based editing. Users currently have to write custom scripts or use fragmented third-party nodes. Adding this enables:
Proposed Change.
Propose the implementation of a standardized node and backend interface to support the OpenAI v1/images/edit endpoint. This will allow users to perform prompt-based image editing (inpainting and outpainting) using DALL-E 2 or GPT-Image models directly within ComfyUI workflows.
High-quality inpainting for users without powerful local GPUs.
Consistency with the existing OpenAI T2I implementation.
Hybrid Workflows: Using local Stable Diffusion for base generation and DALL-E/GPT-Image for final "magic" edits.
### Existing Solutions
_No response_
### Other
I am a contributor for vllm-omni and would like to help with this integration. Comfyui as frontend and vllm-omni as backend would be a great combination.
Contributor guide
Assessment
This issue has not been assessed yet.