[QUESTION] does cuda support fp32 residual connection feature?
Open
bug
module: training
- Dominant language
- Python
- Stars
- 17.9k
- Forks
- 4.5k
- Avg merge
- 4d 3h
- Merged PRs (30d)
- 272
Description
We tried fp32 residual connection on cuda, but the test failed. Is this expected or a bug?
@polisettyvarma
Contributor guide
Assessment
This issue has not been assessed yet.