huggingface / huggingface/trl

FP8 training

Open
#3,399 13 comments 2 reactions 0 assignees View on GitHub
⚡accelerate ✨ enhancement
Dominant language
Python
Stars
19.3k
Forks
3k
Avg merge
1d 20h
Merged PRs (30d)
194

Description

does trl trainer support FP8 training?

https://huggingface.co/docs/accelerate/en/usage_guides/low_precision_training

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.