LAION-AI / LAION-AI/CLIP_benchmark
Add XMRec multilingual retrieval benchmark
Open
Nobody has claimed this yet.
new datasets
- Dominant language
- Python
- Stars
- 814
- Forks
- 103
- PR merge metrics
- No merged PRs in 30d
Description
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Read the XMRec project linked in the issue to understand the multilingual retrieval benchmark and its expected evaluation data. Then inspect the repository's existing CLIP-like evaluation structure to identify the integration point. Done means XMRec is supported as a reproducible benchmark, with its retrieval results included in the evaluation workflow.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100