Comfy-Org / Comfy-Org/ComfyUI

Please add FLUX ClipVision guides and how to get it caught if each ClipVision image has an FLUX encoder

Open
#6,180 0 comments 0 reactions 0 assignees View on GitHub
Feature
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 10h
Merged PRs (30d)
153

Description

### Feature Idea

Next to nothing can encode a waifu wallpaper for a FLUX checkpoint? Please upload an ClipVision SFT encoder image for those like myself as a FLUX user on Comfy

### Existing Solutions

No existing ClipVision encoder solutions are working for FLUX UNet ckpts

### Other

Related errors explaining that missing feature
```
!!! Exception during processing !!! 'NoneType' object has no attribute 'encode_image'
Traceback (most recent call last):
File "/opt/local/.8A/terminal/ComfyAI/ComfyUI/execution.py", line 328, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/local/.8A/terminal/ComfyAI/ComfyUI/execution.py", line 203, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/local/.8A/terminal/ComfyAI/ComfyUI/execution.py", line 174, in _map_node_over_list
process_inputs(input_dict, i)
File "/opt/local/.8A/terminal/ComfyAI/ComfyUI/execution.py", line 163, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/local/.8A/terminal/ComfyAI/ComfyUI/nodes.py", line 990, in encode
output = clip_vision.encode_image(image, crop=crop_image)
^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'encode_image'

fatal: No names found, cannot describe anything.
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.