mlfoundations/open_flamingo

View on GitHub

An open-source framework for training large multimodal models.

Stars: 4.1k
Forks: 319
Open beginner issues: 0
Indexed issues: 45

Dominant language: Python
License: MIT
Last GitHub push: Oct 11, 2023
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

45 open issues indexed

[BUG] ValueError: media_locations must be conditioned before forward pass Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#308 · Opened May 20, 2025
FLICKR30K annotations in coco style availability Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlfoundations/open_flamingo#307 · Opened Nov 4, 2024
problem when load model, image_processor, tokenizer using `create_model_and_transforms()` Open

Difficulty 3/5 1-2 days Newbie friendliness 30/100

mlfoundations/open_flamingo#306 · 1 comment · Opened Sep 19, 2024
[FEATURE REQUEST] Enable Video Training Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlfoundations/open_flamingo#305 · 3 comments · Opened Aug 8, 2024
The format of dataset of mmc4 and laion? So I can train on other dataset. Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

mlfoundations/open_flamingo#304 · 1 reaction · Opened Jul 12, 2024
[BUG] Cannot Initialize Any Models in transformers==4.41.2 Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlfoundations/open_flamingo#303 · 1 comment · Opened Jun 20, 2024
The bug in getting attention weight Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlfoundations/open_flamingo#302 · Opened Jun 20, 2024
what's the meaning of media in input to PerceiverResampler ? Why give time embedding to different media ? Shouldn't given time embedding to different frames? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#301 · 1 comment · 1 reaction · Opened Jun 4, 2024
Implementation Open

Difficulty 5/5 Over a week Newbie friendliness 10/100

mlfoundations/open_flamingo#297 · Opened Apr 28, 2024
Failure to use https://huggingface.co/anas-awadalla/mpt-7b model downloading issue? Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#294 · 1 comment · Opened Mar 22, 2024
[FEATURE REQUEST] Is it possible to train a 3B openflamingo on 4 V100 on one node with deepspeed by simplifying pre-training data used？ Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlfoundations/open_flamingo#293 · Opened Mar 20, 2024
How to try my own fine-tuning experiments Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#292 · 1 comment · Opened Mar 5, 2024
[BUG] ViT-L-14 downloaded in Demo compared to Huggingface Demo Card don't seem to be the same Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlfoundations/open_flamingo#291 · Opened Feb 26, 2024
TypeError: Flamingo.__init__() got an unexpected keyword argument 'cache_dir' Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 35/100

mlfoundations/open_flamingo#290 · 1 comment · Opened Feb 21, 2024
Open Flamingo Perplexity Calculation Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#289 · 3 comments · Opened Feb 11, 2024
Understanding MP policy for parameters Open

bug

Difficulty 1/5 Under an hour Newbie friendliness 25/100

mlfoundations/open_flamingo#288 · Opened Jan 24, 2024
[BUG] an error in get_dataset_size about args.shards Open

bug

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

mlfoundations/open_flamingo#287 · Opened Jan 11, 2024
How to set hyperparameters? Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

mlfoundations/open_flamingo#285 · Opened Dec 31, 2023
'media_token_id' AttributeError Open

bug

mlfoundations/open_flamingo#280 · 1 assignee · Opened Nov 9, 2023
Is context images really needed during few-shot inference? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#278 · Opened Nov 7, 2023
Unable to run on GPU with error: "Cannot copy out of meta tensor; no data!" Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 30/100

mlfoundations/open_flamingo#277 · 2 comments · Opened Nov 6, 2023
Repeated answers in output. Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#265 · 1 comment · Opened Sep 21, 2023
[BUG] Generating text is timing out Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#263 · 1 comment · Opened Sep 19, 2023
Mismatch input type and weight type when training with precision fp16 Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#260 · 7 comments · Opened Sep 16, 2023
Does Flamingo support NLVR^2 and its paired-image input setting? Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlfoundations/open_flamingo#257 · 3 comments · Opened Sep 5, 2023
Support for Onnx format? Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlfoundations/open_flamingo#256 · 1 comment · Opened Sep 5, 2023
About old blocks Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#247 · Opened Aug 23, 2023
Multi-GPU training crashes with "Cannot copy out of meta tensor; no data" Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlfoundations/open_flamingo#243 · Opened Aug 18, 2023
fsdp Error report Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#232 · 3 comments · Opened Aug 1, 2023
About the random selection during pre-training Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlfoundations/open_flamingo#231 · 6 comments · Opened Aug 1, 2023
Training loss curve on MMC4 dataset? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#226 · 8 comments · Opened Jul 22, 2023
How to quantize open_flamingo? Open

bug

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlfoundations/open_flamingo#225 · Opened Jul 18, 2023
[BUG] triton attn not work for mpt-1b-redpajama-200b Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#224 · Opened Jul 17, 2023
Are there some format limitation of the training batches? Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

mlfoundations/open_flamingo#221 · 1 comment · Opened Jul 13, 2023
[FEATURE REQUEST] MMC4 Dataset Preprocess Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

mlfoundations/open_flamingo#218 · 2 comments · 1 reaction · Opened Jul 10, 2023
Can I train OpenFlamingo without LIAON dataset? Open

Difficulty 4/5 3-5 days Newbie friendliness 15/100

mlfoundations/open_flamingo#215 · 3 comments · 1 reaction · Opened Jul 4, 2023
Pin versions for language encoders (i.e. anas-awadalla/mpt-1b-redpajama-200b) Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

mlfoundations/open_flamingo#213 · 1 comment · Opened Jul 3, 2023
Can't reproduce evaluation results of imagenet1k Open

mlfoundations/open_flamingo#200 · 13 comments · 1 assignee · Opened Jun 5, 2023
Malware Detected on LAION2B-En Images. Can you make Open Flamingo Trainable on a Different Dataset? E.g., COYO-700M? Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlfoundations/open_flamingo#197 · 3 comments · Opened May 26, 2023
Error on the model.generate() line: `AttributeError: 'GELU' object has no attribute 'approximate' Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 35/100

mlfoundations/open_flamingo#189 · 1 comment · Opened May 7, 2023
support training on only LAION 2B Open

enhancement good first issue

Difficulty 4/5 3-5 days Newbie friendliness 20/100

mlfoundations/open_flamingo#137 · 5 comments · Opened Mar 30, 2023
OpenFlamingo.int8() Open

mlfoundations/open_flamingo#133 · 6 reactions · 1 assignee · Opened Mar 29, 2023
Notes on FP16 inference Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlfoundations/open_flamingo#130 · 2 comments · 4 reactions · Opened Mar 29, 2023
Instruction about training Open-Flamingo from scratch Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlfoundations/open_flamingo#129 · 26 comments · 1 reaction · Opened Mar 29, 2023
Add VisDial evaluation Open

evaluations

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlfoundations/open_flamingo#122 · Opened Mar 27, 2023

mlfoundations/open_flamingo

Get new issues in your inbox