deepspeedai / deepspeedai/DeepSpeedExamples
why can't I just set the 'data_sampling=true"?
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 6.8k
- Forks
- 1.1k
- Avg merge
- 2d 16h
- Merged PRs (30d)
- 1
Description
I just write in my config as:
{
...,
"data_sampling": {
"enabled": true,
"num_epochs": 100,
"num_workers": 4
}
}
But I still find in my log that 'data_sampling': {'enabled': False, 'num_epochs': 1000, 'num_workers': 0 :
[2023-08-17 20:06:32,178] [INFO] [config.py:964:print] data_efficiency_config ....... {'enabled': False, 'seed': 1234, 'data_sampling': {'enabled': False, 'num_epochs': 1000, 'num_workers': 0, 'curriculum_learning': {'enabled': False}}, 'data_routing': {'enabled': False, 'random_ltd': {'enabled': False, 'layer_token_lr_schedule': {'enabled': False}}}}
What's the matter?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by inspecting config.py around line 964, where the logged data_efficiency_config is printed, and trace how the data_sampling settings are loaded from the shown configuration. Confirm why enabled, num_epochs, and num_workers differ from the supplied values. Done means the configuration is correctly recognized and the log reflects the requested settings.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100