atomic14 / atomic14/voice-controlled-robot

Caution in Training Steps

Open
#18 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
221
Forks
68
PR merge metrics
No merged PRs in 30d

Description

I notice that in the training steps given in the file [Train Model-All Words.ipynb](https://github.com/atomic14/voice-controlled-robot/blob/main/model/Train%20Model-All%20Words.ipynb) in line 12 training dataset part

```python
# create the datasets for training
batch_size = 32

train_dataset = Dataset.from_tensor_slices(
(X_train, Y_train)
).repeat(
count=-1
).shuffle(
len(X_train)
).batch(
batch_size
)

validation_dataset = Dataset.from_tensor_slices((X_validate, Y_validate)).batch(X_validate.shape[0]//10)

test_dataset = Dataset.from_tensor_slices((X_test, Y_test)).batch(len(X_test))
```

We can see that for `train_dataset` it have an option of `Dataset.repeat(count=-1)` which repeats the dataset infiniely while in training. **I want to mention that for those who use custom audio dataset and apply the author code should take full consideration of using this option**. For dataset that are umbalanced it may cause training hard to converge or over-fitting model.

Contributor guide

No contributing guide indexed for this repository

Research direction

Open model/Train Model-All Words.ipynb and inspect the training-dataset cell around line 12, especially the repeat(count=-1) setting. Add a clear caution for users applying the notebook to custom or imbalanced audio datasets, and verify that the warning accurately explains the convergence and overfitting concern.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.