Owner
bigscience-workshop
21 indexed repositories · View on GitHub
-
petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Python · 10565 stars
-
promptsource
Toolkit for creating, sharing and using natural language prompts.
Python · 3034 stars
-
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Python · 1448 stars
-
bigscience
Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
Shell · 1019 stars
-
xmtf
Crosslingual Generalization through Multitask Finetuning
Jupyter Notebook · 534 stars
-
biomedical
Tools for curating biomedical training data for large-scale language modeling
Python · 505 stars
-
t-zero
Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
Python · 463 stars
-
data-preparation
Code used for sourcing and cleaning the BigScience ROOTS corpus
Jupyter Notebook · 318 stars
-
lam
Libraries, Archives and Museums (LAM)
91 stars
-
data_tooling
Tools for managing datasets for governance and training.
HTML · 91 stars
-
multilingual-modeling
BLOOM+1: Adapting BLOOM model to support a new unseen language
Python · 75 stars
-
evaluation
Code and Data for Evaluation WG
Python · 42 stars
-
data_sourcing
This directory gathers the tools developed by the Data Sourcing Working Group
Python · 31 stars
-
metadata
Experiments on including metadata such as URLs, timestamps, website descriptions and HTML tags during pretraining.
Python · 29 stars
-
carbon-footprint
A repository for `codecarbon` logs.
Jupyter Notebook · 13 stars
-
Python · 11 stars
-
pii_processing
PII Processing code to detect and remediate PII in BigScience datasets. Reference implementation for the PII Hackathon
Python · 9 stars
-
ShadesofBias
Evaluation for Shades of Bias in Text
HTML · 9 stars
-
catalogue_data
Scripts to prepare catalogue data
Jupyter Notebook · 8 stars
-
5 stars
- 1 more repository lives on View on GitHub
-
English JSON NER RE
bigscience-workshop/biomedical#256 · 5 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/t-zero#42 · 1 comment · 0 reactions · 0 assignees ·
-
bigscience-workshop/t-zero#43 · 1 comment · 0 reactions · 0 assignees ·
-
CC BY 4.0 English New Dataset
bigscience-workshop/biomedical#257 · 3 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/t-zero#44 · 0 comments · 0 reactions · 0 assignees ·
-
DUA English QA
bigscience-workshop/biomedical#261 · 8 comments · 0 reactions · 1 assignee ·
-
bigscience-workshop/biomedical#338 · 3 comments · 0 reactions · 0 assignees ·
-
Write READMEs Open
bigscience-workshop/data-preparation#6 · 0 comments · 0 reactions · 1 assignee ·
-
New Dataset
bigscience-workshop/biomedical#355 · 7 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/data-preparation#37 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/data-preparation#38 · 0 comments · 0 reactions · 0 assignees ·
-
High New Dataset Private Semantic Textual Similarity
bigscience-workshop/biomedical#356 · 1 comment · 0 reactions · 0 assignees ·
-
bigscience-workshop/data-preparation#39 · 0 comments · 1 reaction · 0 assignees ·
-
French New Dataset
bigscience-workshop/biomedical#360 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/data-preparation#40 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/data-preparation#41 · 0 comments · 0 reactions · 0 assignees ·
-
New Dataset
bigscience-workshop/biomedical#365 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/data-preparation#42 · 0 comments · 0 reactions · 0 assignees ·
-
New Dataset
bigscience-workshop/biomedical#371 · 3 comments · 0 reactions · 1 assignee ·
-
bigscience-workshop/data-preparation#43 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/data-preparation#44 · 0 comments · 0 reactions · 0 assignees ·
-
New Dataset
bigscience-workshop/biomedical#391 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/data-preparation#45 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/biomedical#427 · 1 comment · 0 reactions · 1 assignee ·
-
New Dataset
bigscience-workshop/biomedical#430 · 1 comment · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#67 · 2 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/biomedical#458 · 1 comment · 0 reactions · 0 assignees ·
-
enhancement
bigscience-workshop/metadata#71 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#84 · 1 comment · 0 reactions · 1 assignee ·
-
bug Low
bigscience-workshop/biomedical#510 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#85 · 0 comments · 0 reactions · 1 assignee ·
-
good first issue
bigscience-workshop/biomedical#597 · 3 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#86 · 0 comments · 0 reactions · 1 assignee ·
-
bigscience-workshop/metadata#87 · 0 comments · 0 reactions · 1 assignee ·
-
New Dataset
bigscience-workshop/biomedical#604 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#88 · 1 comment · 0 reactions · 1 assignee ·
-
bigscience-workshop/biomedical#638 · 1 comment · 0 reactions · 1 assignee ·
-
bigscience-workshop/metadata#89 · 0 comments · 0 reactions · 1 assignee ·
-
bigscience-workshop/biomedical#639 · 3 comments · 0 reactions · 1 assignee ·
-
bigscience-workshop/metadata#90 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#91 · 0 comments · 0 reactions · 1 assignee ·
-
DUA High NED/Normalization NER New Dataset
bigscience-workshop/biomedical#647 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#92 · 0 comments · 0 reactions · 1 assignee ·
-
DUA English New Dataset NLI Russian
bigscience-workshop/biomedical#653 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#93 · 0 comments · 0 reactions · 1 assignee ·
-
bigscience-workshop/metadata#94 · 0 comments · 0 reactions · 2 assignees ·
-
New Dataset
bigscience-workshop/biomedical#669 · 1 comment · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#96 · 0 comments · 0 reactions · 1 assignee ·
-
enhancement
bigscience-workshop/biomedical#671 · 0 comments · 0 reactions · 0 assignees ·
-
Start joint training Open
bigscience-workshop/metadata#97 · 0 comments · 0 reactions · 2 assignees ·