mlfoundations/datacomp

View on GitHub

DataComp: In search of the next generation of multimodal datasets

Stars: 792
Forks: 65
Open beginner issues: 0
Indexed issues: 28

Dominant language: Python
License: No license data
Last GitHub push: Apr 28, 2025
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

28 open issues indexed

Smaller scale than "small"? Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

mlfoundations/datacomp#97 · Opened Aug 11, 2026
Is there an option to download just the captions of DataComp-1B? Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlfoundations/datacomp#95 · Opened Jun 4, 2025
Resume download Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/datacomp#93 · Opened Feb 20, 2025
Potential duplicates in rewritten subsets Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/datacomp#92 · Opened Jan 18, 2025
List of uids for the main filter baselines Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

mlfoundations/datacomp#90 · 1 reaction · Opened Oct 2, 2024
Reproducing no-filtering baseline `commonpool_s_s13m_b4k` Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlfoundations/datacomp#89 · Opened Sep 17, 2024
Label Errors in ImageNet-O Eval Set Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlfoundations/datacomp#88 · Opened Jul 17, 2024
Redundant labels in iWILDCAM eval data Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

mlfoundations/datacomp#87 · Opened Jul 16, 2024
Metadata downloading fails and no way to resume the download Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

mlfoundations/datacomp#86 · Opened Jul 6, 2024
Problems in run train.py Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

mlfoundations/datacomp#85 · 3 comments · Opened Jun 30, 2024
Invalid files for Datacomp1B Open

Difficulty 2/5 1-3 hours Newbie friendliness 52/100

mlfoundations/datacomp#84 · Opened May 28, 2024
ImageNet 21k based filtered dataset Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

mlfoundations/datacomp#83 · 1 comment · Opened May 12, 2024
Downloading Commonpool XLarge Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/datacomp#82 · Opened Apr 30, 2024
Availability of npy indices for large pool Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/datacomp#80 · Opened Mar 20, 2024
About update metadata with the corresponding image sample in shards Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlfoundations/datacomp#77 · 2 comments · Opened Jan 25, 2024
Pretraining dataset Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlfoundations/datacomp#73 · 1 comment · Opened Dec 28, 2023
Remove CSAM, if present Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

mlfoundations/datacomp#71 · 3 comments · Opened Dec 20, 2023
the normal success rate and downloading speed? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/datacomp#68 · 1 comment · Opened Oct 4, 2023
14% of SHA256 hashes not matching Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlfoundations/datacomp#67 · 32 comments · 3 reactions · Opened Oct 4, 2023
Usage with AWS S3 and Ray Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

mlfoundations/datacomp#59 · 5 comments · 1 reaction · Opened Sep 16, 2023
Tried evaluate the model on a local network only machine Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

mlfoundations/datacomp#57 · 4 comments · Opened Sep 12, 2023
Not able to push data to google cloud storage Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlfoundations/datacomp#56 · 1 comment · Opened Sep 11, 2023
Connection error while half-downloading metadata Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

mlfoundations/datacomp#45 · 3 comments · Opened Aug 13, 2023
Downloading DataComp-1B Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/datacomp#41 · 1 comment · Opened Jul 29, 2023
download data, why success is always 0.14, but the file size is 80% of the total file (total file size is in README) Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/datacomp#39 · 7 comments · Opened Jul 26, 2023
--output_dir does not do correct thing if --output_dir is a cloud path Open

mlfoundations/datacomp#34 · 1 comment · 1 assignee · Opened Jul 21, 2023
Deduplication of eval datasets Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

mlfoundations/datacomp#30 · 1 comment · Opened Jul 16, 2023
FileNotFoundError while downloading DataComp-1B Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/datacomp#27 · 7 comments · 1 reaction · Opened Jul 7, 2023

mlfoundations/datacomp

Get new issues in your inbox