modelscope / modelscope/DiffSynth-Studio
请问，如何加载Z-image的Fp8模型？或者直接使用fp8推理？
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 13.1k
- Forks
- 1.3k
- Avg merge
- 13h 12m
- Merged PRs (30d)
- 45
Description
虽然已经在readme中看到：
FP8 精度量化会导致明显的图像质量劣化，因此不建议在 Z-Image Turbo 模型上开启任何量化，仅建议开启 CPU Offload，最低 8G 显存即可运行。
但是我可以找到一些比较好的fp8的模型，在50系列显卡可以快很多
所以如何使用fp8进行推理？
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the README's FP8 quantization and CPU offload guidance, then locate the existing Z-Image model-loading and inference entry points; the issue names no files or tests. Done means establishing and documenting a supported way to load FP8 models or run FP8 inference, including hardware requirements and quality trade-offs.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100