Save predictions on test data if test is enabled
Abierto
- Lenguaje dominante
- Python
- Estrellas
- 1.7k
- Forks
- 232
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
Hi SciBERT team, First of all, it is an awesome work. I have a question cum feature request.
Q1.
Is scibert predicting the entity for each token or for a sentence (bunch of tokens) from the test set?
Q2. Is the accuracy/f1 score calculated at the "span label" level (PER) or "IOB label + span label" level (B-PER)?
If we have a feature to save the predictions (in addition to outputting just the acc/f1 score) on the test data when if the test is enabled during training, we can figure out the above such questions ourselves.
Thank you
Guía de contribución
No hay ninguna guía de contribución indexada para este repositorio
Evaluación
Este issue todavía no se ha evaluado.