Comfy-Org / Comfy-Org/ComfyUI

Enable FP8 on rocm for gfx12

Open
#8,242 9 comments 0 reactions 0 assignees View on GitHub
Feature
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 7h
Merged PRs (30d)
158

Description

### Feature Idea

gfx12 (9060, 9070) brings support for fp8 on AMD consumer cards. This functionality is currently soldered off, I think by comfy/model_management.py, if not other parts of the codebase:

```py
def supports_fp8_compute(device=None):
if not is_nvidia():
return False
```

fp8 should be enabled on these platforms, and other AMD cards that support it.

### Existing Solutions

_No response_

### Other

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.