graykode / graykode/nlp-tutorial
Problem with BERT batch generation
Abierto
- Lenguaje dominante
- Jupyter Notebook
- Estrellas
- 14.9k
- Forks
- 3.9k
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
There is a problem with padding on [line 73-75 ](https://github.com/graykode/nlp-tutorial/blob/cb4881ebf6683dc6970c53a2cf50d5fd01edf118/5-2.BERT/BERT-Torch.py#L73). What if the sentence length is larger than [maxlen](https://github.com/graykode/nlp-tutorial/blob/cb4881ebf6683dc6970c53a2cf50d5fd01edf118/5-2.BERT/BERT-Torch.py#L16)? Then we end up with sequences of varying length and [line 214](https://github.com/graykode/nlp-tutorial/blob/cb4881ebf6683dc6970c53a2cf50d5fd01edf118/5-2.BERT/BERT-Torch.py#L214) throws an error.
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.