Comfy-Org / Comfy-Org/ComfyUI

how ot use FlashAttention (flash-attn) in comfyui

Open
#3,373 4 comments 1 reaction 0 assignees View on GitHub
User Support
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 6h
Merged PRs (30d)
155

Description

use this custom_nodes "[ComfyUI-Phi-3-mini](https://github.com/ZHO-ZHO-ZHO/ComfyUI-Phi-3-mini)
Based on the backend prompt, install flash_attention ,
but,“You are not running the flash-attention implementation, expect numerical differences.”
![02](https://github.com/comfyanonymous/ComfyUI/assets/150640855/159aa4b3-9ee9-4494-b4d0-6be1742e72e0)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.