allenai / allenai/pawls

Add CLI dataset management

Abierto
#145 0 comentarios 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Python
Estrellas
435
Forks
80
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

I was thinking of a set of commands, to create a dataset:

```bash
pawls dataset create [DATASET NAME] [INITIAL PDFS]
```

Add pdfs to the dataset:

```bash
pawls dataset add [PDFS]
```

And offer per-dataset configuration for the label-set. Some discussion happening in #144, with the proposal that datasets are top-level folders (w/in `skiff_files`). I think that's the simplest, and would let you drop an overriding configuration file into each dataset folder.

One last concern is *where* the datasets should reside. Would a user need to provide the relative path to the `skiff_files` fiolder for each of the sub-commands, to make sure they're copied into the right place?

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.