lllyasviel / lllyasviel/stable-diffusion-webui-forge

can't run t5 in fp16?

Open
#1,222 8 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
13k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

I tried many unet setting like dev-fp16 with automatic Diffusion in Low Bits/ dev-fp16 with fp8e4m3fn in low bits/ dev-fp8_e4m3fn with automatic Diffusion in Low Bits. but for every single unet setting, i got same images with t5-fp8 and t5-fp16. guess T5 is always cast to fp8?

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the comparison described in the issue using the listed UNet and T5 fp8/fp16 settings, then inspect how those settings are applied during image generation. Done means determining whether T5 actually uses the requested precision and documenting or correcting the reason for identical outputs.

Written by the indexing model from the issue text.

Assessment

Tech stack
machine-learning, python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.