google-research / google-research/FLAN

seqio.get_mixture_or_task('ag_news_subset_template_0_five_shot') failed

Open
#72 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.6k
Forks
160
PR merge metrics
No merged PRs in 30d

Description

python script:
selected_mixture = seqio.get_mixture_or_task('ag_news_subset_template_0_five_shot')
INPUT_SEQ_LEN = 2056
TARGET_SEQ_LEN = 512

dataset = selected_mixture.get_dataset(
sequence_length={"inputs": INPUT_SEQ_LEN, "targets": TARGET_SEQ_LEN},
# split="train",
shuffle=True,
num_epochs=1,
# shard_info=seqio.ShardInfo(index=0, num_shards=10),
use_cached=False,
seed=42
)
for i, ex in enumerate(dataset.take(10)):
print(ex)

this script will report errors:
![image](https://github.com/google-research/FLAN/assets/13724286/90234fdc-7555-47ca-9c54-9a340a0cdb5a)

but when i replace
selected_mixture = seqio.get_mixture_or_task('ag_news_subset_template_0_five_shot')
with
selected_mixture = seqio.get_mixture_or_task('ag_news_subset_template_mix_five_shot')
the result is success, why?

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the provided Python script with ag_news_subset_template_0_five_shot, then compare its behavior with ag_news_subset_template_mix_five_shot. Inspect the mixture and task definitions referenced by these names and identify why one fails during get_dataset; done means the failing lookup or dataset construction is explained and the reported case works or is documented as unsupported.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.