JuliaMath / JuliaMath/Float8s.jl
5 bits for exponent?
Open
enhancement
- Dominant language
- Julia
- Stars
- 22
- Forks
- 7
- PR merge metrics
- No merged PRs in 30d
Description
the new H100 from nvidia has 8-bit floats in two flavors: 4 bits for the exponent like Float8s.jl's Float8_4, and 5 bits. scroll down to "NVIDIA Hopper FP8 data format" here: https://developer.nvidia.com/blog/nvidia-hopper-architecture-in-depth/
have you considered adding this type to Float8s.jl? currently i'm using https://github.com/goualard-f/MicroFloatingPoints.jl to simulate to see if that many exponent bits is better (than 4 or 3), and it is painfully slow.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.