bigscience-workshop / bigscience-workshop/xmtf

How to fineutne mT0 with specific down-stream data?

Open
#12 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
534
Forks
43
PR merge metrics
No merged PRs in 30d

Description

Can you provide the continue fine-tune code for mT0 to specific down-stream data task,we want to test it for specific scene, e.g. retrieval and recommendation.
We find a similar version for continue fine-tuning flan-t5 in https://www.philschmid.de/fine-tune-flan-t5-deepspeed. Is it same to xmtf, or can you provide an official example, just like classification or QA?
Best wishes.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.