How the input data is divided to lexemes and these lexemes are used by the parsers generated by Tunnel Grammar Studio is described in article "Tunnel Parsing with the Token’s Lexeme" published at Cybernetics and Information Technologies, Volume 22, Issue 2 (June 2022). A PDF can be found into the download page here.

At 2022 Aug 15, 13:00 GMT in news channel Tunnel Parsing