CTE parsing fails when name is a non-reserved keyword

Comienza ejecutando los dos reproductores vendor/bin/sql-parser --lint --query y sigue cómo el lexer y el parser gestionan el nombre del CTE después de WITH, incluidos los nombres entre comillas invertidas. Se considera terminado cuando ambas consultas se analicen correctamente, incluidos los nombres de palabras clave no reservadas y los nombres de palabras clave entre comillas, sin los errores indicados.

The parser rejects valid CTEs whose names are non-reserved keywords, throwing:

The name of the CTE was expected.

MySQL has a large set of keywords that are explicitly not reserved (no (R) marker in the official MySQL 9.7 keyword list^1). Non-reserved keywords are explicitly permitted as unquoted identifiers, including CTE names. MySQL executes these queries without error^2.

Reproducer

Unquoted:

vendor/bin/sql-parser --lint --query "WITH data AS (SELECT 1) SELECT * FROM data"

#1: The name of the CTE was expected. (near "data" at position 5)
#2: Unexpected end of the WITH CTE. (near "data" at position 5)
#3: Unrecognized statement type. (near "data" at position 5)

Backtick-quoted (which should unconditionally allow any keyword as an identifier):

vendor/bin/sql-parser --lint --query "WITH `data` AS (SELECT 1) SELECT * FROM `data`"

#1: The name of the CTE was expected. (near "`data`" at position 5)
#2: Unexpected end of the WITH CTE. (near "`data`" at position 5)
#3: Unexpected beginning of statement. (near "`data`" at position 5)
#4: Unrecognized statement type. (near "AS" at position 12)

Expected behaviour

The query parses successfully for any non-reserved keyword used as a CTE name, whether unquoted or backtick-quoted.

Actual behaviour

Parser throws errors in both cases. The root cause appears to be that the lexer classifies all keywords as keyword tokens unconditionally, rather than resolving them contextually. After WITH, the parser expects an identifier token; receiving a keyword token instead, it fails, even though MySQL allows non-reserved keywords in identifier position without quoting, and allows any keyword in identifier position when backtick-quoted.