Possible compatibility issue between InstantID and IPAdapter in recent ComfyUI versions

### Custom Node Testing

- [x] I have tried disabling custom nodes and the issue persists (see [how to disable custom nodes](https://docs.comfy.org/troubleshooting/custom-node-issues#step-1%3A-test-with-all-custom-nodes-disabled) if you need help)

### Expected Behavior

This issue does not occur in older versions of ComfyUI.

Working version: ComfyUI v0.3.42

Recent versions: issue appears when using newer releases.

Using the same official InstantID example workflow and models in v0.3.42, I can run the workflow repeatedly without any degradation in the generated face.

### Actual Behavior

**Description**

I encountered a possible compatibility or caching issue when using InstantID together with IPAdapter Advanced in recent versions of ComfyUI.

The workflow I am using is the official InstantID example workflow, without structural modifications. Both InstantID and IPAdapter are used together to control identity and reference image features.

When running the workflow multiple times with the same reference image, the generated face gradually degrades (identity distortion or collapse) after several runs.

**Observations**

The issue occurs when InstantID and IPAdapter are used together in the same workflow.

After running the workflow several times (usually 3–4 runs), the generated face starts to degrade noticeably.

If I change the reference input image, the output immediately returns to normal.

If I click "Free model and node cache", the output also returns to normal.

If I only use InstantID without IPAdapter, the issue does not occur.

This behavior suggests that there may be some interaction between the two plugins or a caching issue affecting one of them.

**Environment**

ComfyUI version: ComfyUI: v0.17.0

OS: Windows11

Python: 3.12

**Reproduction Steps**

Use the official InstantID example workflow.

Keep the same reference image.

Run the workflow multiple times.

After several runs, the generated face gradually degrades.

Changing the reference image or clicking "Free model and node cache" restores normal output.

Expected Behavior

InstantID and IPAdapter should work together consistently across multiple runs without identity degradation.

Actual Behavior

When both plugins are used together, the generated face gradually degrades after several runs until the node cache is manually cleared or the reference image is changed.

Additional Notes

Since this happens with the official InstantID example workflow, it may indicate a compatibility issue or caching interaction between InstantID and IPAdapter in newer versions of ComfyUI.

### Steps to Reproduce

The issue occurs when InstantID and IPAdapter are used together in the same workflow.

After running the workflow several times (usually 3–4 runs), the generated face starts to degrade noticeably.

If I change the reference input image, the output immediately returns to normal.

If I click "Free model and node cache", the output also returns to normal.

If I only use InstantID without IPAdapter, the issue does not occur.

This behavior suggests that there may be some interaction between the two plugins or a caching issue affecting one of them.

### Debug Logs

Total VRAM 32607 MB, total RAM 65461 MB
pytorch version: 2.10.0+cu130
Set vram state to: NORMAL_VRAM
Device: cuda:0 NVIDIA GeForce RTX 5090 : cudaMallocAsync
Using async weight offloading with 2 streams
Enabled pinned memory 29457.0
working around nvidia conv3d memory bug.
Using pytorch attention
aimdo: src-win/cuda-detour.c:77:INFO:aimdo_setup_hooks: found driver at 00007FFBFA580000, installing 4 hooks
aimdo: src-win/cuda-detour.c:61:DEBUG:install_hook_entrys: hooks successfully installed
aimdo: src/control.c:69:INFO:comfy-aimdo inited for GPU: NVIDIA GeForce RTX 5090 (VRAM: 32606 MB)
DynamicVRAM support detected and enabled
Python version: 3.13.11 (tags/v3.13.11:6278944, Dec 5 2025, 16:26:58) [MSC v.1944 64 bit (AMD64)]
ComfyUI version: 0.17.0
comfy-aimdo version: 0.2.10
comfy-kitchen version: 0.2.8
ComfyUI frontend version: 1.41.18
[Prompt Server] web root: C:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\comfyui_frontend_package\static
Asset seeder disabled
[ComfyUI-Easy-Use] server: v1.3.7 Loaded
[ComfyUI-Easy-Use] web root: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Easy-Use\web_version/v2 Loaded
### Loading: ComfyUI-Impact-Pack (V8.28.2)
[Impact Pack] Wildcard total size (0.00 MB) is within cache limit (50.00 MB). Using full cache mode.
[Impact Pack] Wildcards loading done.
### Loading: ComfyUI-Manager (V3.39.2)
[ComfyUI-Manager] network_mode: private
[ComfyUI-Manager] ComfyUI per-queue preview override detected (PR #11261). Manager's preview method feature is disabled. Use ComfyUI's --preview-method CLI option or 'Settings > Execution > Live preview method'.
ComfyUI Revision: 150 [63d1bbdb] *DETACHED | Released on '2026-03-12'
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json

Import times for custom nodes:
0.0 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\websocket_image_save.py
0.0 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Inpaint-CropAndStitch
0.0 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\cg-use-everywhere
0.0 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\Comfyui_TTP_Toolset
0.0 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus
0.0 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_essentials
0.0 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_UltimateSDUpscale
0.0 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\rgthree-comfy
0.2 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Impact-Pack
0.2 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-SeedVR2_VideoUpscaler
0.5 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Manager
0.8 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_InstantID
0.9 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\was-node-suite-comfyui
2.8 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-mixlab-nodes
2.9 seconds: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Easy-Use

Context impl SQLiteImpl.
Will assume non-transactional DDL.
Starting server

To see the GUI go to: http://192.168.100.9:8188

### Other

[InstantID_IPAdapter_test.json](https://github.com/user-attachments/files/26015169/InstantID_IPAdapter_test.json)