deepspeedai / deepspeedai/DeepSpeedExamples
TypeError: unsupported operand type(s) for *: 'NoneType' and 'int'
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 6.8k
- Forks
- 1.1k
- Avg merge
- 2d 16h
- Merged PRs (30d)
- 1
Description
when I run DeepSpeedExamples-Megatron-LM-v1.1.5-ZeRO3/ and Megatron-LM-v1.1.5-3D_parallelism , I encounter the same problem : TypeError: unsupported operand type(s) for *: 'NoneType' and 'int', Traceback (most recent call last):
File "pretrain_bert.py", line 123, in
args_defaults={'tokenizer_type': 'BertWordPieceLowerCase'})
File "/home/DeepSpeedExamples-master/Megatron-LM-v1.1.5-3D_parallelism/megatron/training.py", line 88, in pretrain
train_valid_test_dataset_provider)
File "/home/DeepSpeedExamples-master/Megatron-LM-v1.1.5-3D_parallelism/megatron/training.py", line 619, in build_train_valid_test_data_iterators
global_batch_size = args.batch_size * data_parallel_size * args.gas
TypeError: unsupported operand type(s) for *: 'NoneType' and 'int'
my python verson is 3.7.10, torch verison is: 1.8.1+cu101.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start at megatron/training.py:619 and the pretrain_bert.py entry point, then reproduce the reported failure in the two example directories. Trace where args.batch_size is set or left unset and verify the resulting behavior with the example run; done means the TypeError is resolved and the expected batch-size configuration is clear.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- distributed-systems, machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100