Owner
bigscience-workshop
21 indexed repositories · View on GitHub
-
petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Python · 10565 stars
-
promptsource
Toolkit for creating, sharing and using natural language prompts.
Python · 3034 stars
-
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Python · 1448 stars
-
bigscience
Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
Shell · 1019 stars
-
xmtf
Crosslingual Generalization through Multitask Finetuning
Jupyter Notebook · 534 stars
-
biomedical
Tools for curating biomedical training data for large-scale language modeling
Python · 505 stars
-
t-zero
Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
Python · 463 stars
-
data-preparation
Code used for sourcing and cleaning the BigScience ROOTS corpus
Jupyter Notebook · 318 stars
-
lam
Libraries, Archives and Museums (LAM)
91 stars
-
data_tooling
Tools for managing datasets for governance and training.
HTML · 91 stars
-
multilingual-modeling
BLOOM+1: Adapting BLOOM model to support a new unseen language
Python · 75 stars
-
evaluation
Code and Data for Evaluation WG
Python · 42 stars
-
data_sourcing
This directory gathers the tools developed by the Data Sourcing Working Group
Python · 31 stars
-
metadata
Experiments on including metadata such as URLs, timestamps, website descriptions and HTML tags during pretraining.
Python · 29 stars
-
carbon-footprint
A repository for `codecarbon` logs.
Jupyter Notebook · 13 stars
-
Python · 11 stars
-
pii_processing
PII Processing code to detect and remediate PII in BigScience datasets. Reference implementation for the PII Hackathon
Python · 9 stars
-
ShadesofBias
Evaluation for Shades of Bias in Text
HTML · 9 stars
-
catalogue_data
Scripts to prepare catalogue data
Jupyter Notebook · 8 stars
-
5 stars
- 1 more repository lives on View on GitHub
-
bigscience-workshop/interpretability-ideas#1 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/interpretability-ideas#2 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/interpretability-ideas#3 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/interpretability-ideas#4 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/interpretability-ideas#5 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/interpretability-ideas#6 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/interpretability-ideas#7 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/interpretability-ideas#8 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/interpretability-ideas#9 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/interpretability-ideas#10 · 0 comments · 0 reactions · 0 assignees ·
-
good first issue
bigscience-workshop/training_dynamics#1 · 4 comments · 0 reactions · 1 assignee ·
-
bigscience-workshop/training_dynamics#2 · 1 comment · 0 reactions · 0 assignees ·
-
good first issue
bigscience-workshop/training_dynamics#3 · 1 comment · 0 reactions · 1 assignee ·
-
good first issue
bigscience-workshop/training_dynamics#4 · 1 comment · 0 reactions · 1 assignee ·
-
good first issue
bigscience-workshop/training_dynamics#6 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/training_dynamics#7 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/training_dynamics#8 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/training_dynamics#9 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/training_dynamics#10 · 0 comments · 0 reactions · 1 assignee ·
-
Set up infrastructure to isolate specific layers or groups of layers in the network for probing Open
bigscience-workshop/training_dynamics#11 · 0 comments · 0 reactions · 1 assignee ·
-
bigscience-workshop/training_dynamics#12 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/catalogue_data#5 · 7 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/catalogue_data#6 · 3 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/catalogue_data#8 · 2 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/catalogue_data#9 · 6 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/catalogue_data#11 · 6 comments · 1 reaction · 0 assignees ·
-
MT
bigscience-workshop/evaluation#4 · 2 comments · 0 reactions · 0 assignees ·
-
MT
bigscience-workshop/evaluation#5 · 5 comments · 0 reactions · 1 assignee ·
-
NLU
bigscience-workshop/evaluation#6 · 2 comments · 0 reactions · 1 assignee ·
-
multilingual NLU
bigscience-workshop/evaluation#7 · 3 comments · 0 reactions · 0 assignees ·
-
multilingual NLG
bigscience-workshop/evaluation#10 · 1 comment · 0 reactions · 0 assignees ·
-
help wanted In-Progress NLG
bigscience-workshop/evaluation#11 · 2 comments · 0 reactions · 1 assignee ·
-
NLG
bigscience-workshop/evaluation#13 · 1 comment · 0 reactions · 0 assignees ·
-
In-Progress NLG
bigscience-workshop/evaluation#14 · 1 comment · 0 reactions · 0 assignees ·
-
NLG
bigscience-workshop/evaluation#15 · 0 comments · 0 reactions · 0 assignees ·
-
In-Progress NLG
bigscience-workshop/evaluation#16 · 3 comments · 0 reactions · 1 assignee ·
-
In-Progress NLG
bigscience-workshop/evaluation#17 · 2 comments · 0 reactions · 0 assignees ·
-
NLG
bigscience-workshop/evaluation#18 · 2 comments · 0 reactions · 0 assignees ·
-
NLG
bigscience-workshop/evaluation#19 · 2 comments · 0 reactions · 1 assignee ·
-
multilingual NER
bigscience-workshop/evaluation#20 · 5 comments · 0 reactions · 0 assignees ·
-
multilingual NER
bigscience-workshop/evaluation#21 · 7 comments · 0 reactions · 0 assignees ·
-
In-Progress linguistic_structure
bigscience-workshop/evaluation#22 · 5 comments · 0 reactions · 1 assignee ·
-
linguistic_structure
bigscience-workshop/evaluation#23 · 2 comments · 0 reactions · 0 assignees ·
-
enhancement help wanted
bigscience-workshop/data_sourcing#5 · 1 comment · 0 reactions · 1 assignee ·
-
linguistic_structure multilingual
bigscience-workshop/evaluation#24 · 1 comment · 0 reactions · 0 assignees ·
-
bigscience-workshop/data_sourcing#6 · 0 comments · 0 reactions · 0 assignees ·
-
In-Progress linguistic_structure multilingual
bigscience-workshop/evaluation#25 · 2 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/data_sourcing#7 · 0 comments · 1 reaction · 0 assignees ·
-
In-Progress linguistic_structure
bigscience-workshop/evaluation#26 · 6 comments · 0 reactions · 1 assignee ·
-
bigscience-workshop/data_sourcing#10 · 0 comments · 0 reactions · 0 assignees ·