facebookresearch / facebookresearch/blt

What are the patch lengths and the initial values of the generated tokens during generation?

Open
#24 33 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.1k
Forks
196
PR merge metrics
No merged PRs in 30d

Description

Hello, thank you very much for your work! If I input the prompt "The capital of France is" into the BLT model, how can I know the patch length for the next generated patch, and how can I initialize the corresponding token embeddings?

Contributor guide

Open the contributing guide

Research direction

The issue names only the BLT model and the example prompt, with no file, test, or entry point to inspect. Start by locating the generation path and its documentation, then clarify where patch lengths and initial token embeddings are exposed; done means the documented procedure answers both questions for the given prompt.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.