dspinellis / dspinellis/tokenizer

Support Ruby

Open
#8 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
66
Forks
21
PR merge metrics
No merged PRs in 30d

Description

The lexical structure is [here](https://ruby-doc.org/docs/ruby-doc-bundle/Manual/man-1.4/syntax.html). However, [the rules are complex](https://idiosyncratic-ruby.com/29-limitations-of-language.html), and the solutions [require taking into account considerable context](https://stackoverflow.com/questions/32159070/how-does-ruby-know-when-is-a-divide-symbol-vs-when-it-starts-a-regular-exp).

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.