Skip to content

Commit

Permalink
FEAT: provides an exhaustive list of datatypes concerned by lexer's O…
Browse files Browse the repository at this point in the history
…PEN/CLOSE events.
  • Loading branch information
dockimbel committed Feb 7, 2024
1 parent 16f61b9 commit 286ae10
Showing 1 changed file with 7 additions and 2 deletions.
9 changes: 7 additions & 2 deletions en/lexer.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -148,9 +148,9 @@ The tokenization process is split in stages, triggering events where a user-prov
----
+-> ERROR
/
+-> CLOSE series
+-> CLOSE container(*)
/
+-> OPEN series
+-> OPEN container(*)
/
-> PRESCAN token -> SCAN token -> LOAD value
\ \ \
Expand All @@ -159,6 +159,11 @@ The tokenization process is split in stages, triggering events where a user-prov

So the lexer events are: `prescan`, `scan`, `load`, `open`, `close`, `error`.

(*) Those events are only emitted for the following datatypes:

* (value containers) block!, paren!, map!, any-path!
* strings using curly brackets (useful to record line numbers of a multiline string beginning/ending)

=== `transcode/trace`

*Syntax*
Expand Down

0 comments on commit 286ae10

Please sign in to comment.