Owner
bigscience-workshop
21 indexed repositories · View on GitHub
-
petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Python · 10565 stars
-
promptsource
Toolkit for creating, sharing and using natural language prompts.
Python · 3034 stars
-
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Python · 1448 stars
-
bigscience
Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
Shell · 1019 stars
-
xmtf
Crosslingual Generalization through Multitask Finetuning
Jupyter Notebook · 534 stars
-
biomedical
Tools for curating biomedical training data for large-scale language modeling
Python · 505 stars
-
t-zero
Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
Python · 463 stars
-
data-preparation
Code used for sourcing and cleaning the BigScience ROOTS corpus
Jupyter Notebook · 318 stars
-
lam
Libraries, Archives and Museums (LAM)
91 stars
-
data_tooling
Tools for managing datasets for governance and training.
HTML · 91 stars
-
multilingual-modeling
BLOOM+1: Adapting BLOOM model to support a new unseen language
Python · 75 stars
-
evaluation
Code and Data for Evaluation WG
Python · 42 stars
-
data_sourcing
This directory gathers the tools developed by the Data Sourcing Working Group
Python · 31 stars
-
metadata
Experiments on including metadata such as URLs, timestamps, website descriptions and HTML tags during pretraining.
Python · 29 stars
-
carbon-footprint
A repository for `codecarbon` logs.
Jupyter Notebook · 13 stars
-
Python · 11 stars
-
pii_processing
PII Processing code to detect and remediate PII in BigScience datasets. Reference implementation for the PII Hackathon
Python · 9 stars
-
ShadesofBias
Evaluation for Shades of Bias in Text
HTML · 9 stars
-
catalogue_data
Scripts to prepare catalogue data
Jupyter Notebook · 8 stars
-
5 stars
- 1 more repository lives on View on GitHub
-
New Dataset
bigscience-workshop/biomedical#672 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#98 · 0 comments · 0 reactions · 1 assignee ·
-
bigscience-workshop/metadata#99 · 1 comment · 0 reactions · 1 assignee ·
-
enhancement
bigscience-workshop/biomedical#675 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#100 · 0 comments · 0 reactions · 1 assignee ·
-
good first issue
bigscience-workshop/biomedical#678 · 0 comments · 0 reactions · 0 assignees ·
-
Evaluation bias Open
bigscience-workshop/metadata#108 · 1 comment · 0 reactions · 1 assignee ·
-
bigscience-workshop/metadata#109 · 0 comments · 0 reactions · 3 assignees ·
-
good first issue
bigscience-workshop/biomedical#680 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#113 · 0 comments · 0 reactions · 1 assignee ·
-
CAS: NED missing Openbug
bigscience-workshop/biomedical#692 · 1 comment · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#122 · 0 comments · 0 reactions · 0 assignees ·
-
bug
bigscience-workshop/biomedical#693 · 0 comments · 0 reactions · 0 assignees ·
-
#dataset Epic
bigscience-workshop/metadata#124 · 0 comments · 3 reactions · 0 assignees ·
-
multi gpu training Open
bigscience-workshop/metadata#129 · 0 comments · 0 reactions · 1 assignee ·
-
bug
bigscience-workshop/biomedical#694 · 0 comments · 0 reactions · 0 assignees ·
-
bigscience-workshop/metadata#138 · 0 comments · 0 reactions · 1 assignee ·
-
bug
bigscience-workshop/biomedical#696 · 0 comments · 0 reactions · 0 assignees ·
-
bug
bigscience-workshop/biomedical#697 · 0 comments · 0 reactions · 0 assignees ·
-
bug
bigscience-workshop/biomedical#698 · 1 comment · 0 reactions · 0 assignees ·
-
data catalog language modeling script
bigscience-workshop/data_tooling#65 · 2 comments · 0 reactions · 1 assignee ·
-
data catalog
bigscience-workshop/data_tooling#75 · 0 comments · 0 reactions · 1 assignee ·
-
data catalog
bigscience-workshop/data_tooling#88 · 3 comments · 0 reactions · 1 assignee ·
-
data catalog
bigscience-workshop/data_tooling#89 · 2 comments · 0 reactions · 1 assignee ·
-
data catalog
bigscience-workshop/data_tooling#91 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog
bigscience-workshop/data_tooling#92 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog
bigscience-workshop/data_tooling#93 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog
bigscience-workshop/data_tooling#95 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog
bigscience-workshop/data_tooling#96 · 2 comments · 0 reactions · 1 assignee ·
-
data catalog need custodian permission
bigscience-workshop/data_tooling#98 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog need custodian permission
bigscience-workshop/data_tooling#100 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog
bigscience-workshop/data_tooling#102 · 3 comments · 0 reactions · 1 assignee ·
-
data catalog need data sourcing feedback
bigscience-workshop/data_tooling#103 · 8 comments · 0 reactions · 1 assignee ·
-
data catalog need data sourcing feedback
bigscience-workshop/data_tooling#106 · 4 comments · 0 reactions · 1 assignee ·
-
data catalog need custodian permission need data sourcing feedback
bigscience-workshop/data_tooling#112 · 5 comments · 0 reactions · 1 assignee ·
-
data catalog invalid need data sourcing feedback
bigscience-workshop/data_tooling#113 · 1 comment · 0 reactions · 1 assignee ·
-
data catalog need custodian permission
bigscience-workshop/data_tooling#117 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog need custodian permission
bigscience-workshop/data_tooling#118 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog need custodian permission
bigscience-workshop/data_tooling#119 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog
bigscience-workshop/data_tooling#120 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog need custodian permission
bigscience-workshop/data_tooling#123 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog need data sourcing feedback
bigscience-workshop/data_tooling#126 · 4 comments · 0 reactions · 1 assignee ·
-
data catalog language modeling script
bigscience-workshop/data_tooling#127 · 10 comments · 0 reactions · 2 assignees ·
-
data catalog need custodian permission need data sourcing feedback
bigscience-workshop/data_tooling#128 · 1 comment · 0 reactions · 0 assignees ·
-
data catalog need custodian permission
bigscience-workshop/data_tooling#133 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog need custodian permission
bigscience-workshop/data_tooling#134 · 3 comments · 0 reactions · 1 assignee ·
-
data catalog
bigscience-workshop/data_tooling#136 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog
bigscience-workshop/data_tooling#138 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog need custodian permission need data sourcing feedback
bigscience-workshop/data_tooling#141 · 0 comments · 0 reactions · 0 assignees ·
-
data catalog need custodian permission
bigscience-workshop/data_tooling#142 · 0 comments · 0 reactions · 0 assignees ·