GPU kernels for optimizers
Open
enhancement
- Dominant language
- Julia
- Stars
- 96
- Forks
- 30
- PR merge metrics
- No merged PRs in 30d
Description
### Motivation and description
Wondering what kind of speedup can be achieved by writing GPU kernels for optimizers.
Take a look at @pxl-th's implementation of Adam below
https://github.com/JuliaNeuralGraphics/NerfUtils.jl/blob/main/src/nn/adam.jl#L100-L117
### Possible Implementation
_No response_
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.