JuliaLang / JuliaLang/Tokenize.jl

Get rid of error_type field in Token.

Open
#47 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Julia
Stars
104
Forks
28
PR merge metrics
No merged PRs in 30d

Description

It is unnecessary for all tokens to store this. Instead just make a few error kinds and have a lookup table for their meaning.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the Token definition and every use of its error_type field in the tokenizer. Determine the required error kinds and the lookup-table meanings before changing the representation. Done means tokens no longer store error_type and error meanings remain available through the new lookup design, with existing behavior preserved.

Written by the indexing model from the issue text.

Assessment

Tech stack
julia
Domain
compilers
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.