facebookresearch / facebookresearch/blt
What is BOE_ID?
Open
- Dominant language
- Python
- Stars
- 2.1k
- Forks
- 196
- PR merge metrics
- No merged PRs in 30d
Description
```
SEP = " "
BOS_ID: int = 1
EOS_ID: int = 2
PAD_ID: int = -1
BOE_ID: int = 0
BPE_ID: int = 3
OFFSET: int = 4
BYTE_UNITS: int = 256
```
Relatively new to this field, and I was wondering what `BOE_ID` represents here and why it is needed. Any clarification/thoughts are appreciated.
Contributor guide
Research direction
Search the repository for BOE_ID and review its definition and uses alongside BOS_ID, EOS_ID, PAD_ID, and BPE_ID. Done means explaining what BOE_ID represents and why it is needed, with the clarification placed wherever the project documents these constants.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- documentation
- Issue type
- Documentation
- Difficulty
- 1/5
- Estimated time
- Under an hour
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100