Comfy-Org / Comfy-Org/ComfyUI

[RFC]: OpenAI Image Edit API Interface for ComfyUI

Open
#11,938 1 comment 3 reactions 0 assignees View on GitHub
Feature
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 7h
Merged PRs (30d)
158

Description

### Feature Idea

Motivation.
While ComfyUI supports local inpainting and OpenAI text-to-image, it lacks a native or well-standardized way to leverage OpenAI's cloud-based editing. Users currently have to write custom scripts or use fragmented third-party nodes. Adding this enables:

Proposed Change.
Propose the implementation of a standardized node and backend interface to support the OpenAI v1/images/edit endpoint. This will allow users to perform prompt-based image editing (inpainting and outpainting) using DALL-E 2 or GPT-Image models directly within ComfyUI workflows.

High-quality inpainting for users without powerful local GPUs.

Consistency with the existing OpenAI T2I implementation.

Hybrid Workflows: Using local Stable Diffusion for base generation and DALL-E/GPT-Image for final "magic" edits.

### Existing Solutions

_No response_

### Other

I am a contributor for vllm-omni and would like to help with this integration. Comfyui as frontend and vllm-omni as backend would be a great combination.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.