hadriansecurity / hadriansecurity/subwiz
Train code + data
Open
- Dominant language
- Python
- Stars
- 391
- Forks
- 25
- PR merge metrics
- No merged PRs in 30d
Description
Guys, are you planning to opensource the training code/data? :)
- I think it makes sense to update the architecture: add RoPE, RMSNorm, qk-norm, etc.
- Experiments with loss, include post training, for example RLVR (reward the model for generating correct domains).
Contributor guide
Assessment
This issue has not been assessed yet.