abhisehk18 / abhisehk18/Medical
Hugingface Bart outputs summary in which first word is ignored
- Lenguaje dominante
- Jupyter Notebook
- Estrellas
- 0
- Forks
- 0
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
hi,
i am trying to finetune BART for text summarization.But the output summary does not show the first word
Example--Bart output-''ings are s o multifocal patchy homogeneous areas of ground glass attenuation with septal thickening in both lung fields '
Actual output--''findings are s o multifocal patchy homogeneous areas of ground glass attenuation with septal thickening in both lung fields .''
i am using pretrained bart-base
tokenizer--
text_input_ids = tokenizer.batch_encode_plus([text],max_length=512,pad_to_max_length=True,
return_tensors='pt',truncation=True)
Guía de contribución
No hay ninguna guía de contribución indexada para este repositorio
Línea de trabajo
Look at the tokenizer configuration and decoding step in the summarization script. The issue likely relates to how special tokens (like BOS/EOS) are handled during generation. Start by examining the tokenizer's encode/decode methods and the model's generate call. Verify the output by comparing token IDs before and after decoding to see if the first token is being dropped.
Escrito por el modelo de indexación a partir del texto del issue.
Evaluación
- Stack tecnológico
- huggingface, jupyter-notebook, python
- Área
- ai, machine-learning
- Tipo de issue
- Error
- Dificultad
- 3/5
- Tiempo estimado
- 1-2 días
- Estado de actividad
- Estancado
- Claridad
- Bastante claro
- Aptitud para principiantes
- 45/100