LAION-AI / LAION-AI/project-menu
Web page dataset (flamingo-like)
Nobody has claimed this yet.
- Dominant language
- No language data
- Stars
- 12
- Forks
- 4
- PR merge metrics
- No merged PRs in 30d
Description
https://arxiv.org/abs/2204.14198
43M pages making 183M images and 182GB of text
Max 5 images (they limit to that) per page.
Sequences of text and image that are broadly in the same context
I think we would need some filtering beyond "dump the whole page"
Quite likely that some images are very unrelated with the rest of the text, which isn't useful
I guess we could use clip to tell us what to keep
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the linked Flamingo paper and the issue’s proposed 43M-page dataset characteristics. The payload does not name repository files, tests, or an implementation entry point. The scope, filtering approach, and completion criteria would need to be decided before work can begin.
Written by the indexing model from the issue text.
Assessment
- Domain
- data, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100