https://en.wikipedia.org/wiki/Lexical_analysis
(any
= [])
Build Lexer - parse code in different tokens
(Array
= [])
Array of Tokens to parser
Function:
Function that is return array of tokens
Merge the regular expressions into one and add the sticky to it.
(RegExp)
RegExp:
Union of several regexp
Get token that is defined
(String)
String:
Name of Token