ForNeVeR / ForNeVeR/Cesium

C23-compliant lexer

Open
#76 0 comments 0 reactions 0 assignees View on GitHub
area:parser kind:feature status:help-wanted
Dominant language
C#
Stars
451
Forks
49
Avg merge
13h 59m
Merged PRs (30d)
6

Description

Currently, we're using a C lexer from [Yoakke](https://github.com/LanguageDev/Yoakke), a wonderful language toolkit.

Though, it's not currently known how good the lexer is regarding the actual standard.

We should write tests and ensure the lexer is good enough to be the backbone of our parser, with relation to the following sections of the C standard:
- [ ] 6.4 Lexical elements
- [ ] 6.4.1 Keywords
- [ ] 6.4.2 Identifiers
- [ ] 6.4.3 Universal character names
- [ ] 6.4.4 Constants
- [ ] 6.4.4.1 Integer constants
- [ ] 6.4.4.2 Floating constants
- [ ] 6.4.4.3 Enumeration constants
- [ ] 6.4.4.4 Character constants
- [ ] 6.4.5 String literals
- [ ] 6.4.6 Punctuators
- [ ] 6.4.7 Header names
- [ ] 6.4.8 Preprocessing numbers
- [ ] 6.4.9 Comments

Note that certain features of the C standard may be hard to implement in the actual lexer, so they may involve parser support. This is okay, but still have to be thoroughly tested.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.