Comfy-Org / Comfy-Org/ComfyUI

fp8 manually casted to float16

Open
#12,583 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 7h
Merged PRs (30d)
158

Description

Started the comfyui with ```--fp8_e5m2-unet```, but when I start the workflow, there's a message:

```
model weight dtype torch.float8_e5m2, manual cast: torch.float16
```

My GPU is RTX4060 so ideally it should support fp8.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.