allenai / allenai/longformer

I am not able to set global attention mask. I have although given two sep tokens between question and context

Ouverte
#97 7 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
Langage dominant
Python
Étoiles
2.2k
Forks
286
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

outputs = model(**inputs)
File "C:\Users\Rudraksh\Anaconda3\envs\bert_pre\lib\site-packages\torch\nn\modules\module.py", line 547, in __call__
result = self.forward(*input, **kwargs)
File "d:\transformers\src\transformers\modeling_longformer.py", line 1345, in forward
global_attention_mask = _compute_global_attention_mask(input_ids, self.config.sep_token_id)
File "d:\transformers\src\transformers\modeling_longformer.py", line 84, in _compute_global_attention_mask
question_end_index = _get_question_end_index(input_ids, sep_token_id)
File "d:\transformers\src\transformers\modeling_longformer.py", line 73, in _get_question_end_index
), f"There should be exactly three separator tokens: {sep_token_id} in every sample for questions answering. You might also consider to set `global_attention_mask` manually in the forward function to avoid this error."
AssertionError: There should be exactly three separator tokens: 2 in every sample for questions answering. You might also consider to set `global_attention_mask` manually in the forward function to avoid this error.

Guide de contribution

Aucun guide de contribution indexé pour ce dépôt

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.