huggingface / huggingface/transformers

Request addition of 'GPT2ForwardBackward' models

Open
#11,847 0 comments 0 reactions 0 assignees View on GitHub
New model
Dominant language
Python
Stars
166k
Forks
34.6k
Avg merge
3d 8h
Merged PRs (30d)
276

Description

# 🌟 Request addition of 'GPT2ForwardBackward' models

## Model description

Code for running forward and backward versions of GPT-2 XL. These were trained for the paper:

**Reflective Decoding: Beyond Unidirectional Generation with Off-the-Shelf Language Models**; Peter West, Ximing Lu, Ari Holtzman, Chandra Bhagavatula, Jena Hwang, and Yejin Choi; ACL (2021)

https://arxiv.org/abs/2010.08566

## Open source status

* [ X] the model implementation is available: (https://github.com/peterwestuw/GPT2ForwardBackward)
* [ X] the model weights are available: (same link as above)
* [ X] who are the authors: (See arvix credits above)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.