abhisehk18 / abhisehk18/Medical

Hugingface Bart outputs summary in which first word is ignored

Abierto
#1 0 comentarios 0 reacciones 0 asignados Ver en GitHub
bug good first issue help wanted
Lenguaje dominante
Jupyter Notebook
Estrellas
0
Forks
0
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

hi,
i am trying to finetune BART for text summarization.But the output summary does not show the first word
Example--Bart output-''ings are s o multifocal patchy homogeneous areas of ground glass attenuation with septal thickening in both lung fields '
Actual output--''findings are s o multifocal patchy homogeneous areas of ground glass attenuation with septal thickening in both lung fields .''

i am using pretrained bart-base
tokenizer--
text_input_ids = tokenizer.batch_encode_plus([text],max_length=512,pad_to_max_length=True,
return_tensors='pt',truncation=True)

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Línea de trabajo

Look at the tokenizer configuration and decoding step in the summarization script. The issue likely relates to how special tokens (like BOS/EOS) are handled during generation. Start by examining the tokenizer's encode/decode methods and the model's generate call. Verify the output by comparing token IDs before and after decoding to see if the first token is being dropped.

Escrito por el modelo de indexación a partir del texto del issue.

Evaluación

Stack tecnológico
huggingface, jupyter-notebook, python
Área
ai, machine-learning
Tipo de issue
Error
Dificultad
3/5
Tiempo estimado
1-2 días
Estado de actividad
Estancado
Claridad
Bastante claro
Aptitud para principiantes
45/100

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.