Owner
EleutherAI
52 indexed repositories · View on GitHub
-
lm-evaluation-harness
A framework for few-shot evaluation of language models.
Python · 13983 stars
-
gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
Python · 7463 stars
-
pythia
The hub for EleutherAI's work on interpretability and learning dynamics
Jupyter Notebook · 2932 stars
-
Python · 1675 stars
-
Python · 1097 stars
-
cookbook
Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
Python · 852 stars
-
sparsify
Sparsify transformers with SAEs and transcoders
Python · 739 stars
-
polyglot
Polyglot: Large Language Models of Well-balanced Competence in Multi-languages
488 stars
-
DALLE-mtf
Open-AI's DALL-E for large scale training in mesh-tensorflow.
Python · 432 stars
-
Jupyter Notebook · 354 stars
-
delphi
Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models ...
Python · 275 stars
-
concept-erasure
Erasing concepts from neural representations with provable guarantees
Python · 268 stars
-
elk
Keeping language models honest by directly eliciting knowledge encoded in their activations.
Python · 225 stars
-
oslo
OSLO: Open Source for Large-scale Optimization
Python · 176 stars
-
Python · 165 stars
-
knowledge-neurons
A library for finding knowledge neurons in pretrained transformer models.
Python · 159 stars
-
pyfra
Python Research Framework
Python · 107 stars
-
Python · 94 stars
-
dps
Data processing system for polyglot
Python · 93 stars
-
stackexchange-dataset
Python tools for processing the stackexchange data dumps into a text dataset for Language Models
Python · 87 stars
- 32 more repositories live on View on GitHub
-
README Open
EleutherAI/grouch#1 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/pile-allpoetry#1 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/pile-uspto#2 · 0 comments · 0 reactions · 0 assignees ·
-
Experiments Good First Issue
EleutherAI/radioactive-lab#5 · 6 comments · 1 reaction · 1 assignee ·
-
EleutherAI/tqdm-multiprocess#1 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/tqdm-multiprocess#2 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/pile-pubmedcentral#1 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/lm_perplexity#2 · 1 comment · 0 reactions · 0 assignees ·
-
data collection
EleutherAI/lm-scope#8 · 0 comments · 0 reactions · 0 assignees ·
-
data collection
EleutherAI/lm-scope#9 · 0 comments · 0 reactions · 0 assignees ·
-
add lm-eval-harness Opendata collection
EleutherAI/lm-scope#10 · 1 comment · 0 reactions · 0 assignees ·
-
data collection
EleutherAI/lm-scope#11 · 0 comments · 0 reactions · 0 assignees ·
-
data collection opinions wanted
EleutherAI/lm-scope#12 · 0 comments · 0 reactions · 0 assignees ·
-
visualization
EleutherAI/lm-scope#13 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/DALLE-mtf#9 · 0 comments · 1 reaction · 0 assignees ·
-
Got Error Open
EleutherAI/DALLE-mtf#10 · 1 comment · 0 reactions · 0 assignees ·
-
EleutherAI/knowledge-neurons#2 · 5 comments · 0 reactions · 0 assignees ·
-
EleutherAI/knowledge-neurons#34 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/knowledge-neurons#35 · 2 comments · 0 reactions · 0 assignees ·
-
EleutherAI/groupoid-rl#2 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/vqgan-clip#7 · 2 comments · 0 reactions · 0 assignees ·
-
EleutherAI/vqgan-clip#8 · 3 comments · 0 reactions · 0 assignees ·
-
EleutherAI/vqgan-clip#14 · 10 comments · 0 reactions · 0 assignees ·
-
EleutherAI/vqgan-clip#16 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/vqgan-clip#17 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/vqgan-clip#19 · 1 comment · 0 reactions · 0 assignees ·
-
EleutherAI/vqgan-clip#20 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/text-generation-testing-ui#10 · 4 comments · 0 reactions · 0 assignees ·
-
EleutherAI/text-generation-testing-ui#14 · 3 comments · 0 reactions · 0 assignees ·
-
EleutherAI/text-generation-testing-ui#16 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/text-generation-testing-ui#23 · 1 comment · 0 reactions · 0 assignees ·
-
EleutherAI/openwebtext2#7 · 1 comment · 1 reaction · 0 assignees ·
-
EleutherAI/openwebtext2#8 · 6 comments · 7 reactions · 0 assignees ·
-
EleutherAI/magiCARP#21 · 3 comments · 0 reactions · 0 assignees ·
-
Refactor magiCARP. Open
EleutherAI/magiCARP#24 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/magiCARP#30 · 1 comment · 0 reactions · 0 assignees ·
-
nan gradients Open
EleutherAI/magiCARP#31 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/pyfra#8 · 0 comments · 0 reactions · 0 assignees ·
-
Type annotations Open
EleutherAI/pyfra#13 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/pyfra#16 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/pyfra#17 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/pyfra#18 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/pyfra#20 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/pyfra#21 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/pyfra#22 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/pyfra#23 · 0 comments · 0 reactions · 0 assignees ·
-
docs: docs are empty Open
EleutherAI/pyfra#28 · 0 comments · 0 reactions · 0 assignees ·
-
EleutherAI/mp_nerf#4 · 0 comments · 0 reactions · 0 assignees ·
-
Expand Common Crawl dataset to include more timespans, probably even the entire history of crawls Open
EleutherAI/pilev2#7 · 0 comments · 0 reactions · 0 assignees ·
-
RoyalRoad Open
EleutherAI/pilev2#8 · 0 comments · 0 reactions · 0 assignees ·