pub fn tokens(source: &str, file: FileId) -> Vec<Token>
The tokens of source, ending with Eof. Lexing errors are left to parse.
source
Eof
parse