EleutherAI / EleutherAI/lm-scope
key/query/value visualization
Open
data collection
opinions wanted
- Dominant language
- Jupyter Notebook
- Stars
- 4
- Forks
- 1
- PR merge metrics
- No merged PRs in 30d
Description
We don't have a good way of visualizing the key/query/value vectors. It's possible to look at those activations directly, but it might be too much data to be useful. New methods might be needed here.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.