Longformer for autoregression
Open
- Dominant language
- Python
- Stars
- 2.2k
- Forks
- 286
- PR merge metrics
- No merged PRs in 30d
Description
How do I use your longformer for autoregressive tasks? The paper says that you have coded longformer for autoregressive tasks but then the GitHub repo is saying that dilated window and autoregression is not supported? Does Lonformer have the capability for autoregression, and if so, how would you recommend I go about training the model (from scratch preferred) for autoregressive tasks. Any guidance is most appreciated. Thank you.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.