allenai / allenai/ir_datasets

Datamaestro integration

Aperta
#94 2 commenti 0 reazioni 0 assegnatari Vedi su GitHub
enhancement
Lingua principale
Python
Stelle
391
Fork
58
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

**Is your feature request related to a problem? Please describe.**

Integration within datamaestro

**Describe the solution you'd like**

I am working on integrating `ir-datasets` into [datamestro](https://github.com/experimaestro/datamaestro) so that querying available datasets is more standardized (JSON generation, etc.), which in turns provides a way to automate indexing and retrieval (see e.g. [retrieval with experimaestro-ir](https://experimaestro-ir.readthedocs.io/en/latest/)).

It would also allow to consider dataset management within ir-datasets (cleanup, [documentation](https://datamaestro-text.readthedocs.io/en/latest/datamaestro/df/text/com.microsoft.msmarco.passage.html) and maybe more when `datamaestro` matures)

**Describe alternatives you've considered**

None

**Additional context**

At the moment, I am coding within [experimaestro-ir](https://experimaestro-ir.readthedocs.io/en/latest/) but would be glad to move the code to irds and modifying `datamaestro` so that it is more generic (abstracting away dataset access). If moving to `ir_datasets`, the code will be isolated so that it only is triggered when datamaestro is installed and used.

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.