Owner
allenai
264 indexed repositories · View on GitHub
-
olmocr
Toolkit for linearizing PDFs for LLM datasets/training
Python · 19468 stars
-
OLMo
Modeling, training, eval, and inference code for OLMo
Python · 6677 stars
-
open-instruct
AllenAI's post-training codebase
Python · 3864 stars
-
RL4LMs
A modular RL library to fine-tune language models to human preferences
Python · 2395 stars
-
longformer
Longformer: The Long-Document Transformer
Python · 2207 stars
-
scispacy
A full spaCy pipeline and models for scientific/biomedical documents.
Python · 1990 stars
-
ai2thor
An open-source platform for Visual AI.
C# · 1791 stars
-
scibert
A BERT model for scientific text.
Python · 1715 stars
-
bilm-tf
Tensorflow implementation of contextualized word representations from bi-directional language models
Python · 1609 stars
-
bi-att-flow
Bi-directional Attention Flow (BiDAF) network is a multi-stage hierarchical process that represents context at different levels of granul...
Python · 1546 stars
-
dolma
Data and tools for generating and inspecting OLMo pre-training data.
Python · 1544 stars
-
OLMo-core
PyTorch building blocks for the OLMo ecosystem
Python · 1533 stars
-
objaverse-xl
🪐 Objaverse-XL is a Universe of 10M+ 3D Objects. Contains API Scripts for Downloading and Processing!
Python · 1359 stars
-
s2orc
S2ORC: The Semantic Scholar Open Research Corpus: https://www.aclweb.org/anthology/2020.acl-main.447/
Python · 1087 stars
-
OLMoE
OLMoE: Open Mixture-of-Experts Language Models
Jupyter Notebook · 1079 stars
-
natural-instructions
Expanding natural instructions
Python · 1048 stars
-
mmc4
MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
Python · 954 stars
-
molmo
Code for the Molmo Vision-Language Model
Python · 933 stars
-
XNOR-Net
ImageNet classification using binary Convolutional Neural Networks
Lua · 872 stars
-
papermage
library supporting NLP and CV research on scientific papers
Python · 803 stars
- 244 more repositories live on View on GitHub
-
DINO codes Open
allenai/container#2 · 1 comment · 0 reactions · 0 assignees ·
-
Answer type F1 calculation in the evaluator is different from the one on the model's forward pass Open
allenai/qasper-led-baseline#14 · 0 comments · 0 reactions · 1 assignee ·
-
allenai/qasper-led-baseline#18 · 2 comments · 0 reactions · 0 assignees ·
-
allenai/qasper-led-baseline#23 · 1 comment · 0 reactions · 0 assignees ·
-
allenai/qasper-led-baseline#28 · 1 comment · 0 reactions · 0 assignees ·
-
help wanted
allenai/dont-stop-pretraining#3 · 0 comments · 2 reactions · 0 assignees ·
-
allenai/dont-stop-pretraining#19 · 3 comments · 0 reactions · 0 assignees ·
-
allenai/dont-stop-pretraining#25 · 1 comment · 0 reactions · 0 assignees ·
-
allenai/dont-stop-pretraining#26 · 9 comments · 3 reactions · 0 assignees ·
-
About data selection Open
allenai/dont-stop-pretraining#30 · 0 comments · 0 reactions · 0 assignees ·
-
allenai/dont-stop-pretraining#31 · 0 comments · 0 reactions · 0 assignees ·
-
allenai/dont-stop-pretraining#32 · 4 comments · 5 reactions · 0 assignees ·
-
allenai/dont-stop-pretraining#36 · 0 comments · 0 reactions · 0 assignees ·
-
allenai/dont-stop-pretraining#37 · 2 comments · 0 reactions · 0 assignees ·
-
allenai/dont-stop-pretraining#38 · 0 comments · 0 reactions · 0 assignees ·
-
allenai/dont-stop-pretraining#39 · 1 comment · 0 reactions · 0 assignees ·
-
Does DAPT lead to forgetting over the original LM domain or overfitting over the target domain? Open
allenai/dont-stop-pretraining#40 · 0 comments · 0 reactions · 0 assignees ·
-
allenai/dont-stop-pretraining#42 · 0 comments · 0 reactions · 0 assignees ·
-
allenai/pacer-docket-parser#5 · 1 comment · 0 reactions · 0 assignees ·
-
some questions Open
allenai/few-shot-comet#2 · 0 comments · 0 reactions · 0 assignees ·
-
allenai/lm-explorer#7 · 0 comments · 0 reactions · 0 assignees ·
-
allenai/lm-explorer#12 · 1 comment · 1 reaction · 0 assignees ·
-
allenai/lm-explorer#15 · 0 comments · 0 reactions · 0 assignees ·
-
Example sentence Open
allenai/lm-explorer#17 · 0 comments · 0 reactions · 0 assignees ·
-
CUDA support Open
allenai/lm-explorer#18 · 0 comments · 0 reactions · 0 assignees ·
-
allenai/lm-explorer#19 · 0 comments · 0 reactions · 0 assignees ·
-
allenai/lm-explorer#23 · 0 comments · 0 reactions · 0 assignees ·
-
JNLPBA dataset Open
allenai/scibert#26 · 3 comments · 0 reactions · 1 assignee ·
-
allenai/scibert#42 · 1 comment · 0 reactions · 0 assignees ·
-
allenai/scibert#48 · 4 comments · 0 reactions · 0 assignees ·
-
allenai/scibert#52 · 1 comment · 0 reactions · 0 assignees ·
-
allenai/scibert#53 · 1 comment · 0 reactions · 0 assignees ·
-
allenai/scibert#54 · 1 comment · 0 reactions · 0 assignees ·
-
allenai/scibert#57 · 1 comment · 0 reactions · 0 assignees ·
-
allenai/scibert#59 · 5 comments · 0 reactions · 0 assignees ·
-
SciVocab Preparation Open
allenai/scibert#60 · 1 comment · 0 reactions · 0 assignees ·
-
allenai/scibert#64 · 1 comment · 0 reactions · 0 assignees ·
-
allenai/scibert#65 · 3 comments · 0 reactions · 0 assignees ·
-
allenai/scibert#66 · 2 comments · 0 reactions · 0 assignees ·
-
allenai/scibert#68 · 5 comments · 0 reactions · 0 assignees ·
-
allenai/scibert#69 · 0 comments · 0 reactions · 0 assignees ·
-
Error in NER script Open
allenai/scibert#70 · 0 comments · 0 reactions · 0 assignees ·
-
allenai/scibert#74 · 1 comment · 0 reactions · 0 assignees ·
-
allenai/scibert#75 · 0 comments · 0 reactions · 0 assignees ·
-
Export Error Open
allenai/scibert#77 · 0 comments · 0 reactions · 0 assignees ·
-
allenai/scibert#78 · 4 comments · 0 reactions · 0 assignees ·
-
allenai/scibert#79 · 4 comments · 0 reactions · 0 assignees ·
-
allenai/scibert#80 · 5 comments · 1 reaction · 0 assignees ·