Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow turning off string expansion #212

Closed
tjvr opened this issue Mar 25, 2017 · 0 comments
Closed

Allow turning off string expansion #212

tjvr opened this issue Mar 25, 2017 · 0 comments

Comments

@tjvr
Copy link
Collaborator

tjvr commented Mar 25, 2017

It doesn't make sense to expand string literals into characters when using a custom tokeniser.

For the built-in tokeniser, literal strings should instead match the value of the token. (The %-syntax must be used for matching the token's type.) This change is useful for e.g. tosh, where I use literal words all over the place, or more generally for matching specific keywords.

Relates to our solution for #166. Only really makes sense after #198.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant