fix: ExternalOneByteStringResource is not guaranteed to be valid UTF-8 #1532
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
A subtle unsoundness / undefined behaviour made its way into the fairly recently added
ExternalOneByteStringResource
object: Theas_str
API is not sound as the data inside may be be Latin-1, not ASCII.As the API was not used anywhere in deno or deno_core, I opted to simply remove it and replace it with an
as_bytes
API. I also modified the test to showcase the Latin-1 string case and added copious notes and explanations around the code to make sure this doesn't accidentally happen again. The likely reason why the API originally slipped in is because theOneByteConst
has this API where it is safe because theOneByteConst
creation checks the data for ASCII-ness.I also tried to add an API to extract an
Option<&'static OneByteConst>
from an&ExternalOneByteStringResource
but run into rust-lang/rust#119618 ie. OneByteConst is actually duplicating the vtables... which is not great.Closes #1531