atomic14 / atomic14/voice-controlled-robot
Caution in Training Steps
- Dominant language
- Jupyter Notebook
- Stars
- 221
- Forks
- 68
- PR merge metrics
- No merged PRs in 30d
Description
I notice that in the training steps given in the file [Train Model-All Words.ipynb](https://github.com/atomic14/voice-controlled-robot/blob/main/model/Train%20Model-All%20Words.ipynb) in line 12 training dataset part
```python
# create the datasets for training
batch_size = 32
train_dataset = Dataset.from_tensor_slices(
(X_train, Y_train)
).repeat(
count=-1
).shuffle(
len(X_train)
).batch(
batch_size
)
validation_dataset = Dataset.from_tensor_slices((X_validate, Y_validate)).batch(X_validate.shape[0]//10)
test_dataset = Dataset.from_tensor_slices((X_test, Y_test)).batch(len(X_test))
```
We can see that for `train_dataset` it have an option of `Dataset.repeat(count=-1)` which repeats the dataset infiniely while in training. **I want to mention that for those who use custom audio dataset and apply the author code should take full consideration of using this option**. For dataset that are umbalanced it may cause training hard to converge or over-fitting model.
Contributor guide
No contributing guide indexed for this repository
Research direction
Open model/Train Model-All Words.ipynb and inspect the training-dataset cell around line 12, especially the repeat(count=-1) setting. Add a clear caution for users applying the notebook to custom or imbalanced audio datasets, and verify that the warning accurately explains the convergence and overfitting concern.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, tensorflow
- Domain
- documentation, machine-learning
- Issue type
- Documentation
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100