Skip to main content

Module lexer

Module lexer 

Source
Expand description

Turns source text into tokens. Strings are split into text and interpolation tokens so the parser handles "{expr}" with the ordinary expression grammar.

Structsยง

Lexer ๐Ÿ”’

Enumsยง

Mode ๐Ÿ”’

Constantsยง

ESCAPES
The characters that may follow \\ in a string.

Functionsยง

escape ๐Ÿ”’
text written as the inside of a string literal, so unescape gives it back.
lex ๐Ÿ”’
unescape ๐Ÿ”’
The text of a StringText token with its escapes applied.