Comfy-Org / Comfy-Org/ComfyUI

'text generate ' node too slow

Open
#15,072 1 comment 1 reaction 0 assignees View on GitHub
Feature
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 7h
Merged PRs (30d)
158

Description


llama-cpp plugin can run gguf 10 times faster than 'text generate ' node . can we use int4 text encoder to speed too?

https://github.com/lihaoyun6/ComfyUI-llama-cpp_vlm

Contributor guide

Open the contributing guide

Research direction

Start by locating the “text generate” node and compare its GGUF and text-encoder handling with the linked ComfyUI-llama-cpp_vlm plugin. Benchmark the current path and determine whether int4 text-encoder support is feasible; done means a documented, reproducible speed improvement without changing generation behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.