Comfy-Org / Comfy-Org/ComfyUI

Could we get a fp16 patch/hack for ernie-image on turing cards similar to what was done with anima?

Open
#13,413 1 comment 0 reactions 0 assignees View on GitHub
Feature
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 7h
Merged PRs (30d)
158

Description

### Feature Idea

Currently on 20 series cards Ernie-image defaults to fp32 which is very slow. It would be great if we could get a hack similar to what is done with anima/cosmos2 and some other models which usually break in fp16.

For quicker reference here is the pr which added the fp16 patch for cosmos2: https://github.com/Comfy-Org/ComfyUI/pull/12249

### Existing Solutions

I have a modified version of the old anima patch made to work with ernie here:
https://github.com/BetaDoggo/ernie-image-fp16-comfyui
Not applicable to a proper solution but it works for me for now

### Other

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.