bigscience-workshop / bigscience-workshop/petals

Exploding gradients/weights/logits in a fine-tuning notebook

Open
#283 2 comments 1 reaction 1 assignee Claimed by @justheuristic View on GitHub
bug good first issue help wanted
Dominant language
Python
Stars
10.6k
Forks
650
PR merge metrics
No merged PRs in 30d

Description

Hello, after I successfully fine-tuned, I run to the last step and when generating text, the following error occurs.
May I ask what is the reason?

![image](https://user-images.githubusercontent.com/7599454/224216132-416b7044-dee1-4401-a7c7-c2f76ea37660.png)
![image](https://user-images.githubusercontent.com/7599454/224216173-81b75b67-79d0-4b6f-a654-2cf500ea07d5.png)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.