EleutherAI / EleutherAI/pythia

How does one obtain the loss for each model, size and checkpoint in the table in the main paper?

Open
#194 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2.9k
Forks
224
PR merge metrics
No merged PRs in 30d

Description

Hi!

Awesome work!

I was wondering, how can I easily get the pythia losses fro the original paper?

ref: https://arxiv.org/abs/2304.01373

Image

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.