google-research / google-research/FLAN

Doubt about the TARGET parameter in the dataset

Open
#86 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.6k
Forks
160
PR merge metrics
No merged PRs in 30d

Description

First I would like to thank you every single person that worked to make this dataset available.

I am studying the repository as well as the papers about FLAN. And I couldn't understand the `target` parameter.

Do you guys use such parameter to fine tune the language model in supervised way? Similar to what would be a reinforcement learning with human feedback?

For example, when you ask the question to the language models it uses the `target` value to understand if its response is right or wrong based on the `target` value? Thus, it can learn its mistakes from the `target` value?

In general my question is - when does the parameter `target` comes into place when training the model using the FLAN dataset?

Contributor guide

Open the contributing guide

Research direction

Read the repository documentation and the FLAN papers referenced in the issue to determine how the dataset's target parameter is used during training. Done means documenting a clear explanation of when target is consumed and how it relates, if at all, to supervised fine-tuning or reinforcement learning.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.