Internal documentation — Work in progress
This page has not been confirmed as accurate or approved for publication. Current documentation version: 0.1.0-internal.1.
First program
The repository includes examples/tokenizer_demo.sagan, which exercises
keywords, interfaces, classes, numbers, collections, strings, interpolation,
exception vocabulary, and an emoji identifier.
Build and tokenize it:
To inspect another file:
The output is a stream such as token name, half-open source span, original token text, and decoded value where applicable.
Tokenizer example, not executable Sagan
The demo expresses intended Sagan syntax and is verified as tokenizer input. No parser or evaluator exists, so it cannot yet be compiled or run.
To see a deliberate lexical failure:
That file contains 1e, which fails because scientific notation requires
exponent digits.