CarperAI / CarperAI/InstructGPT

[task] Instruction-Induction Benchmark Tasks

Open
#14 0 comments 0 reactions 0 assignees View on GitHub
task
Dominant language
No language data
Stars
71
Forks
4
PR merge metrics
No merged PRs in 30d

Description

### 🚀 The Task

The model should be able to follow the instruction-induction benchmark tasks outlined in Table 1 of Honovich et al.'s [Instruction Induction: From Few Examples to Natural Language Task Descriptions](https://arxiv.org/pdf/2205.10782.pdf#page=4)

### Example

Screen Shot 2022-11-08 at 16 39 20

### Additional Notes

* Google Sheets Reference: [CarperAI: Instruct-GPT Tasks](https://docs.google.com/spreadsheets/d/1q6I0PLcgvNjcls3z7diUOoDGmNojUW-m6KhX2ijuSEE/edit?usp=sharing)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.