Loss in training loops
Open
good first issue
- Dominant language
- Python
- Stars
- 23
- Forks
- 28
- Avg merge
- 4d 12h
- Merged PRs (30d)
- 5
Description
# Issue
## Problem Description
The last batch of each epoch is usually smaller than the others. One approach is to sum the losses and divide by the total number of samples.
Currently, loss calculations in handlers sum the average loss of each batch and divide by the length of the dataloader.
## Expected Behavior
## What Needs to be Done
## How Can It Be Tested or Reproduced
Contributor guide
Assessment
This issue has not been assessed yet.