stdlib helpers: literal, layernorm, unsqueeze
Open
- Dominant language
- Rust
- Stars
- 34
- Forks
- 7
- PR merge metrics
- No merged PRs in 30d
Description
Add some helpers:
- [x] Literal: add a helper to create F32 / U32 literals and use in the GPT2 implementation
- [ ] LayerNorm
- [x] Move LayerNorm to stdlib, reduce boilerplate using helpers
- [ ] Create a `Module` for `LayerNorm` operating on rank-2 tensors, and a helper to call it
- [ ] Squeeze / Unsqueeze helpers
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.