JuliaLang / JuliaLang/Tokenize.jl
Get rid of error_type field in Token.
Open
- Dominant language
- Julia
- Stars
- 104
- Forks
- 28
- PR merge metrics
- No merged PRs in 30d
Description
It is unnecessary for all tokens to store this. Instead just make a few error kinds and have a lookup table for their meaning.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the Token definition and every use of its error_type field in the tokenizer. Determine the required error kinds and the lookup-table meanings before changing the representation. Done means tokens no longer store error_type and error meanings remain available through the new lookup design, with existing behavior preserved.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- julia
- Domain
- compilers
- Issue type
- Refactor
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100