Owner
bigscience-workshop
21 indexed repositories · View on GitHub
-
petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Python · 10565 stars
-
promptsource
Toolkit for creating, sharing and using natural language prompts.
Python · 3034 stars
-
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Python · 1448 stars
-
bigscience
Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
Shell · 1019 stars
-
xmtf
Crosslingual Generalization through Multitask Finetuning
Jupyter Notebook · 534 stars
-
biomedical
Tools for curating biomedical training data for large-scale language modeling
Python · 505 stars
-
t-zero
Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
Python · 463 stars
-
data-preparation
Code used for sourcing and cleaning the BigScience ROOTS corpus
Jupyter Notebook · 318 stars
-
lam
Libraries, Archives and Museums (LAM)
91 stars
-
data_tooling
Tools for managing datasets for governance and training.
HTML · 91 stars
-
multilingual-modeling
BLOOM+1: Adapting BLOOM model to support a new unseen language
Python · 75 stars
-
evaluation
Code and Data for Evaluation WG
Python · 42 stars
-
data_sourcing
This directory gathers the tools developed by the Data Sourcing Working Group
Python · 31 stars
-
metadata
Experiments on including metadata such as URLs, timestamps, website descriptions and HTML tags during pretraining.
Python · 29 stars
-
carbon-footprint
A repository for `codecarbon` logs.
Jupyter Notebook · 13 stars
-
Python · 11 stars
-
pii_processing
PII Processing code to detect and remediate PII in BigScience datasets. Reference implementation for the PII Hackathon
Python · 9 stars
-
ShadesofBias
Evaluation for Shades of Bias in Text
HTML · 9 stars
-
catalogue_data
Scripts to prepare catalogue data
Jupyter Notebook · 8 stars
-
5 stars
- 1 more repository lives on View on GitHub
-
linguistic_structure
bigscience-workshop/evaluation#27 · 0 comments · 0 reactions · 0 assignees ·
-
Discord link broken Open
bigscience-workshop/data_sourcing#11 · 0 comments · 0 reactions · 0 assignees ·
-
few_shot
bigscience-workshop/evaluation#28 · 2 comments · 0 reactions · 0 assignees ·
-
few_shot
bigscience-workshop/evaluation#29 · 2 comments · 0 reactions · 1 assignee ·
-
bigscience-workshop/tokenization#3 · 0 comments · 0 reactions · 0 assignees ·
-
few_shot multilingual
bigscience-workshop/evaluation#30 · 0 comments · 0 reactions · 0 assignees ·
-
few_shot
bigscience-workshop/evaluation#31 · 3 comments · 0 reactions · 0 assignees ·
-
few_shot
bigscience-workshop/evaluation#32 · 2 comments · 0 reactions · 0 assignees ·
-
few_shot
bigscience-workshop/evaluation#33 · 3 comments · 0 reactions · 0 assignees ·
-
few_shot
bigscience-workshop/evaluation#34 · 3 comments · 0 reactions · 0 assignees ·
-
social_impact
bigscience-workshop/evaluation#35 · 2 comments · 0 reactions · 0 assignees ·
-
social_impact
bigscience-workshop/evaluation#36 · 4 comments · 0 reactions · 0 assignees ·
-
In-Progress social_impact
bigscience-workshop/evaluation#37 · 5 comments · 0 reactions · 2 assignees ·
-
social_impact
bigscience-workshop/evaluation#38 · 2 comments · 0 reactions · 0 assignees ·
-
engineering
bigscience-workshop/evaluation#40 · 1 comment · 0 reactions · 4 assignees ·
-
engineering
bigscience-workshop/evaluation#48 · 0 comments · 0 reactions · 0 assignees ·
-
simple_benchmark
bigscience-workshop/evaluation#49 · 1 comment · 0 reactions · 2 assignees ·
-
multilingual simple_benchmark
bigscience-workshop/evaluation#50 · 9 comments · 0 reactions · 2 assignees ·
-
documentation
bigscience-workshop/evaluation#54 · 1 comment · 3 reactions · 2 assignees ·
-
Setup testing Openengineering
bigscience-workshop/evaluation#57 · 2 comments · 0 reactions · 3 assignees ·
-
bigscience-workshop/evaluation#61 · 2 comments · 3 reactions · 0 assignees ·
-
bigscience-workshop/evaluation#64 · 0 comments · 0 reactions · 1 assignee ·
-
bigscience-workshop/evaluation#73 · 0 comments · 0 reactions · 0 assignees ·
-
Create labels Openmaintenance
bigscience-workshop/lam#2 · 0 comments · 0 reactions · 1 assignee ·
-
Create Project table Openmaintenance
bigscience-workshop/lam#4 · 6 comments · 0 reactions · 1 assignee ·
-
dataset good first issue
bigscience-workshop/lam#35 · 1 comment · 0 reactions · 0 assignees ·
-
dataset
bigscience-workshop/lam#36 · 0 comments · 0 reactions · 0 assignees ·
-
dataset
bigscience-workshop/lam#37 · 0 comments · 0 reactions · 0 assignees ·
-
dataset
bigscience-workshop/lam#39 · 0 comments · 0 reactions · 0 assignees ·
-
documentation
bigscience-workshop/lam#40 · 1 comment · 2 reactions · 0 assignees ·
-
dataset
bigscience-workshop/lam#41 · 5 comments · 0 reactions · 1 assignee ·
-
dataset good first issue
bigscience-workshop/lam#43 · 1 comment · 0 reactions · 0 assignees ·
-
dataset
bigscience-workshop/lam#44 · 0 comments · 0 reactions · 0 assignees ·
-
dataset good first issue
bigscience-workshop/lam#45 · 2 comments · 0 reactions · 1 assignee ·
-
Add dataset: nb-tale Opendataset
bigscience-workshop/lam#48 · 1 comment · 0 reactions · 0 assignees ·
-
candidate-dataset
bigscience-workshop/lam#54 · 1 comment · 0 reactions · 0 assignees ·
-
dataset ready for review
bigscience-workshop/lam#58 · 5 comments · 0 reactions · 2 assignees ·
-
dataset
bigscience-workshop/lam#64 · 3 comments · 1 reaction · 1 assignee ·
-
dataset
bigscience-workshop/lam#65 · 1 comment · 0 reactions · 0 assignees ·
-
dataset
bigscience-workshop/lam#69 · 14 comments · 0 reactions · 1 assignee ·
-
dataset
bigscience-workshop/lam#70 · 40 comments · 0 reactions · 1 assignee ·
-
dataset
bigscience-workshop/lam#71 · 17 comments · 0 reactions · 1 assignee ·
-
candidate-dataset
bigscience-workshop/lam#72 · 12 comments · 0 reactions · 0 assignees ·
-
dataset
bigscience-workshop/lam#75 · 8 comments · 0 reactions · 1 assignee ·
-
bigscience-workshop/lam#76 · 2 comments · 0 reactions · 0 assignees ·
-
dataset
bigscience-workshop/lam#79 · 3 comments · 0 reactions · 0 assignees ·
-
candidate-dataset
bigscience-workshop/lam#80 · 2 comments · 0 reactions · 0 assignees ·
-
dataset
bigscience-workshop/lam#81 · 0 comments · 0 reactions · 0 assignees ·
-
dataset
bigscience-workshop/lam#82 · 0 comments · 0 reactions · 0 assignees ·
-
Add dataset: TexBiG Opendataset
bigscience-workshop/lam#84 · 0 comments · 0 reactions · 0 assignees ·