LAION-AI / LAION-AI/project-menu
Handle multiple captions
Open
Nobody has claimed this yet.
- Dominant language
- No language data
- Stars
- 12
- Forks
- 4
- PR merge metrics
- No merged PRs in 30d
Description
do a laion-like dataset but with multiple caption per sample : dedup per url+caption not by url ; then group by url at the end
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the dataset construction, URL-based deduplication, and final grouping logic in the repository. Confirm how samples with multiple captions are represented, then verify that deduplication uses both URL and caption and that records are grouped by URL only at the end.
Written by the indexing model from the issue text.
Assessment
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100