deepspeedai / deepspeedai/DeepSpeedExamples
error running DeepSpeedExamples/BingBertSquad/run_squad_deepspeed.sh
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 6.8k
- Forks
- 1.1k
- Avg merge
- 2d 16h
- Merged PRs (30d)
- 1
Description
Error encountered running DeepSpeedExamples/BingBertSquad/run_squad_deepspeed.sh
$ ./run_squad_deepspeed.sh 16 ~/models/bert-base-uncased/pytorch_model.bin ~/datasets/squad_data ~/output
11/23/2021 15:42:24 - INFO - __main__ - Loading Pretrained Bert Encoder from: /home/bduser/models/bert-base-uncas/pytorch_model.bin
VOCAB SIZE: 30528
Traceback (most recent call last):
File "nvidia_run_squad_deepspeed.py", line 1163, in <module>
11/23/2021 15:42:24 - INFO - __main__ - Loading Pretrained Bert Encoder from: /home/bduser/models/bert-base-uncas/pytorch_model.bin
main()
File "nvidia_run_squad_deepspeed.py", line 842, in main
raise ValueError("Unable to find model state in checkpoint")
ValueError: Unable to find model state in checkpoint
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the command in DeepSpeedExamples/BingBertSquad/run_squad_deepspeed.sh with the referenced checkpoint and dataset paths. Read nvidia_run_squad_deepspeed.py around main() line 842 and the checkpoint-loading path; compare the expected model state with the supplied checkpoint. Done means the script accepts the checkpoint and proceeds past the reported ValueError.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100