allenai / allenai/longformer

ModuleAttributeError: 'RobertaEmbeddings' object has no attribute 'position_ids'

Open
#152 10 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
2.2k
Forks
285
PR merge metrics
No merged PRs in 30d

Description

run notebook
code:
logger.info(f'Converting roberta-base into roberta-base-{model_args.max_pos}')
model, tokenizer = create_long_model(
save_model_to = model_path, attention_window=model_args.attention_window, max_pos=model_args.max_pos)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.