aidotse / aidotse/LeakPro

Loss in training loops

Open
#239 1 comment 0 reactions 0 assignees View on GitHub
good first issue
Dominant language
Python
Stars
23
Forks
28
Avg merge
4d 12h
Merged PRs (30d)
5

Description

# Issue
## Problem Description

The last batch of each epoch is usually smaller than the others. One approach is to sum the losses and divide by the total number of samples.

Currently, loss calculations in handlers sum the average loss of each batch and divide by the length of the dataloader.

## Expected Behavior

## What Needs to be Done

## How Can It Be Tested or Reproduced

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.