bigscience-workshop / bigscience-workshop/petals
Prompt Tuning met NaN error
Open
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 650
- PR merge metrics
- No merged PRs in 30d
Description
I tried to run the code for [prompt tuning example](https://github.com/bigscience-workshop/petals/blob/main/examples/prompt-tuning-personachat.ipynb), but got the NaN error after some iterations.
Does anybody know the reason for such error? Thanks :)
The dots after the training curve mean NaN.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.