EleutherAI / EleutherAI/elk

Plotting for individual predictions across depth

Open
#67 0 comments 0 reactions 1 assignee Claimed by @Benw8888 View on GitHub
enhancement
Dominant language
Python
Stars
225
Forks
30
PR merge metrics
No merged PRs in 30d

Description

Given a set of reporters for each layer of a model and a fixed input, we can extract the model's "belief" at each layer and see how it evolves over time, similar to how the [tuned lens](https://github.com/norabelrose/tuned-lens) works.

This is low-ish priority, but I think this should be done in time for the paper at least.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.