rust-lang / rust-lang/rust-analyzer

Generate `*_FIRST` parser `TokenSet`s

Open
#14,130 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

A-infra A-parser C-enhancement
Dominant language
Rust
Stars
16.9k
Forks
2.2k
Avg merge
1d 12h
Merged PRs (30d)
72

Description

We should be able to mostly generate these from the ungrammar file I think instead of maintaining the manually (and risking them becoming outdated which they partially are),

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue proposes generating *_FIRST parser TokenSets from the ungrammar file instead of maintaining them manually. Start by locating the ungrammar input and current TokenSet definitions, then trace how they are consumed by the parser. Done means the relevant TokenSets are generated from the grammar and no longer require manual maintenance.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
compilers
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.