huggingface / huggingface/transformers

Knowledge Retrieval missing from BlenderBot Implementation

Open
#10,365 0 comments 0 reactions 0 assignees View on GitHub
New model
Dominant language
Python
Stars
166k
Forks
34.6k
Avg merge
3d 8h
Merged PRs (30d)
276

Description

# 🚀 Feature request

The original Blenderbot [paper](https://arxiv.org/pdf/2004.13637.pdf) considered three transformer based models (Retrieval, Generator and RetNRef), however from what I can see only the generator model is implemented within this repository: [transformers/src/transformers/models/blenderbot/modeling_blenderbot.py](https://github.com/huggingface/transformers/blame/master/src/transformers/models/blenderbot/modeling_blenderbot.py).

## Motivation

As part of my academic work I am generating topic bound conversations and wish to compare Blenderbot as well as make modifications to its knowledge retrieval component. It would be useful if someone could point me towards this (if it is already implemented) or inform me if this feature is planned to be added in the future.

![image](https://user-images.githubusercontent.com/77219112/108953393-d8e5db00-76b6-11eb-8b26-4ee0b123755d.png)

## Contribution

Prior to making a contribution I want to confirm that feature is not implemented and there is no intention of implementing this in the near future.

Thanks,
Alex

@patrickvonplaten @patil-suraj

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.