bigscience-workshop / bigscience-workshop/xmtf

Controlled generation

Open
#15 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
534
Forks
43
PR merge metrics
No merged PRs in 30d

Description

Hi!
Thanks for the amazing job!

Have a couple of quick questions. I'm trying to use mT0-xxl-mt for QA. When I provide the context and ask a question, subject of which is not presented in the context, the model anyway provide something from the context even if it's totally wrong. Ideal scenario in this case - is if the model could output like 'I cannot answer this question with this context" or something like that.
1) It that possible without hard training on additional data?
2) Bias matter question. If I train the model on additional data, would the model still provide "good" answers when the subject of question is in the context?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.