EleutherAI / EleutherAI/text-generation-testing-ui
Maximum number of tokens
Open
- Dominant language
- JavaScript
- Stars
- 15
- Forks
- 13
- PR merge metrics
- No merged PRs in 30d
Description
Hi Thanks for the great work!
I would love to know how many tokens can GPT-J-6B in the web demo can actually attend ?
While GPT-3 playground can accept maximum 2048 tokens (read + write),
in the GPT-J demo it can accept more than 2500 tokens.
Does the web demo truncate the input tokens to sum number (e.g. 1024) or it can actually recieve more tokens than 2500?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.