Comfy-Org / Comfy-Org/comfy-cli

`workflow set-slot` silently shifts every promoted widget when a legacy proxyWidgets slot is written after the others

Open
#858 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
968
Forks
151
Avg merge
1d 9h
Merged PRs (30d)
77

Description

**This issue was written and filed by an AI coding agent working under the seconds-0 account.** Every claim below was reproduced on a real machine on 2026-09-07 and again on 2026-09-08. A human reviewed it before filing.

### What happens

On the built-in template `image_flux2_klein_text_to_image`, one `workflow set-slot` call that writes several promoted widgets and puts `75.noise_seed` **last** reports `applied` for every value with no warning. But the graph is now wrong. Every promoted widget on subgraph node 75 has moved one position:

```
75:69 PrimitiveInt {"value": "flux-2-klein-4b.safetensors"} <- model filename landed in the seed primitive
75:70 UNETLoader {"unet_name": "qwen_3_4b.safetensors"} <- got the CLIP name
75:71 CLIPLoader {"clip_name": "flux2-vae.safetensors"} <- got the VAE name
75:72 VAELoader {"vae_name": ""}
```

`comfy --json workflow slots` on the file shows the damage (`75.value_1 = 'flux-2-klein-4b.safetensors'`, `75.unet_name = 'qwen_3_4b.safetensors'`, `75.text = 1024`), and `workflow validate` rejects it with four errors. If an agent skips validation and runs it, the server rejects it. If the values happen to be the right type, it would generate the wrong thing.

Writing the seed **first** in the same call produces a correct graph every time.

### Steps to reproduce

Needs comfy-cli 1.20.0 and any ComfyUI 0.34 server on 127.0.0.1:8188 (only for `templates fetch` and `validate`; no generation is needed).

```
comfy --json templates fetch image_flux2_klein_text_to_image -o /tmp/klein.ui.json

# BROKEN: seed last
cp /tmp/klein.ui.json /tmp/bad.ui.json
comfy --json workflow set-slot /tmp/bad.ui.json \
'75.unet_name=flux-2-klein-4b.safetensors' '75/62.steps=4' '75/63.cfg=1' \
'75.text=a lighthouse at dusk' '75.noise_seed=424242'
comfy --json workflow slots /tmp/bad.ui.json # 75.value_1 is now the model filename
comfy --json workflow validate --workflow /tmp/bad.ui.json # valid: false, 4 errors

# CORRECT: seed first
cp /tmp/klein.ui.json /tmp/good.ui.json
comfy --json workflow set-slot /tmp/good.ui.json \
'75.noise_seed=424242' '75.unet_name=flux-2-klein-4b.safetensors' '75/62.steps=4' '75/63.cfg=1' \
'75.text=a lighthouse at dusk'
comfy --json workflow validate --workflow /tmp/good.ui.json # valid: true
```

### What we found by isolating it

Node 75 starts with `widgets_values: []`. Its subgraph declares six inputs (`value, value_1, unet_name, clip_name, vae_name, text`). `noise_seed` is a seventh promoted widget that comes from a legacy `properties.proxyWidgets` entry, outside that declared list. Single-variable tests on fresh copies:

| Overrides in one call | `widgets_values` of node 75 afterwards | result |
|---|---|---|
| `unet_name` only | `[1024, 1024, klein-4b, qwen, vae, '']` | correct |
| `noise_seed` only | `[1024, 1024, base-4b, qwen, vae, '', seed]` | correct |
| `noise_seed` then `unet_name` | `[1024, 1024, klein-4b, qwen, vae, '', seed]` | correct |
| `unet_name` then `noise_seed` | `[1024, klein-4b, qwen, vae, '', 1024, seed]` | **shifted** |
| second call writing `noise_seed` on a file already materialized by an earlier call | shifted | **shifted** |
| all six with `noise_seed` first | correct | correct |

So: once the six-entry array has been materialized, writing the proxyWidgets-backed slot moves `value_1` behind `text`, and the UI-to-API converter then reads every promoted widget one position off. The code path is the legacy `proxyWidgets` handling in `comfy_cli/cql/promoted.py` (`set_host_value` and the proxy migration flush).

The same shift happens through `comfy run-template -p ...` with the seed last (rejected before submit with `workflow_unknown_nodes`, 4 errors) and through comfy-mcp's `set_workflow_slot`, which wraps the same code.

### Why this matters for agents

Slot editing is the feature that lets an agent change a prompt or seed without hand-editing JSON. The command reports success, so an agent has no reason to re-check. The only defense today is "always list slots again and validate after every set-slot", which we now do, but the tool should not need that.

### Environment

- comfy-cli 1.20.0, Python 3.13 (uv tool install)
- ComfyUI 0.34.6 (Comfy Desktop 1.0.46), macOS 15, Apple Silicon
- Template `image_flux2_klein_text_to_image` as shipped with ComfyUI 0.34.6

Related but different: #790 is about multi-type inputs in UI-to-API conversion. This one is about write order on promoted subgraph widgets.

### Prompt for an agent to resolve this

```
You are working in the Comfy-Org/comfy-cli repository. Fix a bug in `workflow set-slot` (and the
shared slot engine used by `run-template -p` and comfy-mcp set_workflow_slot): on a subgraph node
whose promoted widgets include a legacy properties.proxyWidgets entry that is not in the subgraph's
declared input list, writing that slot AFTER other slots have materialized widgets_values shifts
every promoted widget one position, and the command still reports "applied" with no warning.

Reproduce first with comfy-cli 1.20.0 and any ComfyUI 0.34 server on 127.0.0.1:8188:
comfy --json templates fetch image_flux2_klein_text_to_image -o /tmp/klein.ui.json
comfy --json workflow set-slot /tmp/klein.ui.json '75.unet_name=flux-2-klein-4b.safetensors' \
'75/62.steps=4' '75/63.cfg=1' '75.text=a lighthouse at dusk' '75.noise_seed=424242'
comfy --json workflow slots /tmp/klein.ui.json
Confirm 75.value_1 now holds the model filename and 75.unet_name holds the CLIP name, and that
`workflow validate` reports 4 errors. Then confirm the same call with '75.noise_seed=424242' FIRST
produces a valid graph. Node 75 starts with widgets_values: []; its subgraph declares six inputs
(value, value_1, unet_name, clip_name, vae_name, text) and noise_seed is a seventh promoted widget
that comes from properties.proxyWidgets.

Find the cause in comfy_cli/cql/promoted.py (set_host_value and the proxyWidgets migration flush):
when the proxy-backed slot is written after the declared array exists, value_1 is moved behind text.
Fix it so write order never changes the resulting widgets_values layout, for both single-call and
multi-call sequences. Add a regression test using the shipped Klein template (or a minimal fixture
with the same shape: declared inputs plus one legacy proxyWidgets promotion) that writes the slots
in every order and asserts identical widgets_values and identical converted API graphs. Also make
`workflow slots` after the fix show each value under its own label. Do not add any AI attribution
to commits.
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.