apple / apple/pfl-research

Document the default metrics reported

Open
#84 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
358
Forks
43
Avg merge
9h 2m
Merged PRs (30d)
2

Description

Training prints metrics each central iteration. There is a structure to this and some default metrics are always provided.

E.g.
image

Describe what are the different populations (Train / Val / Central Val),
when is it useful to look at metrics before and after local training,
and what does the default metrics (total weight, number of data points, number of devices, number of parameters, learning rate) mean

(57424771)

Contributor guide

Open the contributing guide

Research direction

Start by locating the documentation and example or entry point that describes metrics printed during each central iteration. Explain the Train, Val, and Central Val populations, the usefulness of before- and after-local-training metrics, and the meanings of total weight, data points, devices, parameters, and learning rate. Done means these defaults are clearly documented with the example output as context.

Written by the indexing model from the issue text.

Assessment

Tech stack
machine-learning
Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.