dspinellis / dspinellis/tokenizer
Support Ruby
Open
- Dominant language
- C++
- Stars
- 66
- Forks
- 21
- PR merge metrics
- No merged PRs in 30d
Description
The lexical structure is [here](https://ruby-doc.org/docs/ruby-doc-bundle/Manual/man-1.4/syntax.html). However, [the rules are complex](https://idiosyncratic-ruby.com/29-limitations-of-language.html), and the solutions [require taking into account considerable context](https://stackoverflow.com/questions/32159070/how-does-ruby-know-when-is-a-divide-symbol-vs-when-it-starts-a-regular-exp).
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.