allenai / allenai/scibert

Save predictions on test data if test is enabled

Abierto
#53 1 comentario 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Python
Estrellas
1.7k
Forks
232
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

Hi SciBERT team, First of all, it is an awesome work. I have a question cum feature request.

Q1.
Is scibert predicting the entity for each token or for a sentence (bunch of tokens) from the test set?

Q2. Is the accuracy/f1 score calculated at the "span label" level (PER) or "IOB label + span label" level (B-PER)?

If we have a feature to save the predictions (in addition to outputting just the acc/f1 score) on the test data when if the test is enabled during training, we can figure out the above such questions ourselves.

Thank you

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.