Skip to content

Latest commit

 

History

History

Tokenizer

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
Makefile
Makefile
 
 
README.md
README.md
 
 
Tokenizer.dats
Tokenizer.dats
 
 

README.md

Tokenizer

The code in this example implements a simple tokenizer that turns a linear stream of characters into a linear stream of tokens (for identifer names and (unsigned) integers).

Happy programming in ATS!!!