You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It doesn't make sense to expand string literals into characters when using a custom tokeniser.
For the built-in tokeniser, literal strings should instead match the value of the token. (The %-syntax must be used for matching the token's type.) This change is useful for e.g. tosh, where I use literal words all over the place, or more generally for matching specific keywords.
Relates to our solution for #166. Only really makes sense after #198.
The text was updated successfully, but these errors were encountered:
It doesn't make sense to expand string literals into characters when using a custom tokeniser.
For the built-in tokeniser, literal strings should instead match the
value
of the token. (The%
-syntax must be used for matching the token'stype
.) This change is useful for e.g. tosh, where I use literal words all over the place, or more generally for matching specific keywords.Relates to our solution for #166. Only really makes sense after #198.
The text was updated successfully, but these errors were encountered: