About input formats for training and inference
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 882
- Forks
- 76
- PR merge metrics
- No merged PRs in 30d
Description
Anygpt is trained only with the Next Token Prediction task.
Take text to image as an example，Is the training input speech tokens text tokens image tokens music tokens?
I want to know the input formats for training and inference.
training input ：<sos> speech tokens <eos> text tokens <soi> image tokens <eoi> <som> music tokens,
training label ：speech tokens <eos> text tokens <soi> image tokens <eoi> <som> music tokens <eom>. Is my understanding correct about training input and label?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by locating the training and inference input-format documentation or examples, then compare them with the proposed token sequences. Done means the expected training input, label, and inference formats are documented clearly.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, machine-learning
- Issue type
- Documentation
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100