Datamaestro integration
- Lingua principale
- Python
- Stelle
- 391
- Fork
- 58
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
**Is your feature request related to a problem? Please describe.**
Integration within datamaestro
**Describe the solution you'd like**
I am working on integrating `ir-datasets` into [datamestro](https://github.com/experimaestro/datamaestro) so that querying available datasets is more standardized (JSON generation, etc.), which in turns provides a way to automate indexing and retrieval (see e.g. [retrieval with experimaestro-ir](https://experimaestro-ir.readthedocs.io/en/latest/)).
It would also allow to consider dataset management within ir-datasets (cleanup, [documentation](https://datamaestro-text.readthedocs.io/en/latest/datamaestro/df/text/com.microsoft.msmarco.passage.html) and maybe more when `datamaestro` matures)
**Describe alternatives you've considered**
None
**Additional context**
At the moment, I am coding within [experimaestro-ir](https://experimaestro-ir.readthedocs.io/en/latest/) but would be glad to move the code to irds and modifying `datamaestro` so that it is more generic (abstracting away dataset access). If moving to `ir_datasets`, the code will be isolated so that it only is triggered when datamaestro is installed and used.
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Valutazione
Questa issue non è ancora stata valutata.