EleutherAI / EleutherAI/lm-scope

More advanced queries

Open
#13 0 comments 0 reactions 0 assignees View on GitHub
visualization
Dominant language
Jupyter Notebook
Stars
4
Forks
1
PR merge metrics
No merged PRs in 30d

Description

In order to support more advanced queries without loading too much on the browser, we should use a database with indices. There queries can be grouped into two general categories:
1. Based on some collection of prompts (i.e., that match a certain pattern), visualize some aspect of the model (i.e., a specific attention head)
2. Based on a behavior of the model (i.e., a specific attention head) find all the prompts that exhibit (or don't exhibit) this behavior.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.