ageron / ageron/handson-ml2

[QUESTION] How exactly does auxiliary output in a NN help regularize

Open
#516 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
30k
Forks
13.1k
PR merge metrics
No merged PRs in 30d

Description

Hi
In chapter 10, under "use cases for multiple outputs", the last point says that auxiliary outputs can help regularize.

The exact bullet point is -
Another use case is as a regularization technique (i.e., a training constrain whose objective is to reduce overfitting and thus improve the model's ability to generalize). For example, you may want to add some auxiliary outputs in a NN architecture to ensure that the underlying part of the network learns something useful on its own, without relying on the rest of the network.

I just don't understand this. How exactly does it regularize? I detailed explanation would be appreciated!
Thanks

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.