Fix data corruption, Port [#18525] to branch-2.10 #18546
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
### What changes are proposed in this pull request? A this fix a bug in corrupted data files. Previously, Alluxio#17497 attempt to solve this issue but only covers the case when creating a UFS reader Notice we only handle block reader. So this may not fix `paged Block Reader` in 2.x ### Why are the changes needed? Please clarify why the changes are needed. For instance, 1. If you propose a new API, clarify the use case for a new API. 2. If you fix a bug, describe the bug. ### Does this PR introduce any user facing changes? Please list the user-facing changes introduced by your change, including 1. change in user-facing APIs 2. addition or removal of property keys 3. webui pr-link: Alluxio#18525 change-id: cid-bbba0feb29231e70750e5e79da5f405bb591d47a
|
Automated checks report:
Some checks failed. Please fix the reported issues and reply |
jja725
force-pushed
the
cherry-pick-data-corruption
branch
from
8461597
to
aab5259
Compare
yuzhu
changed the title
|
Automated checks report:
All checks passed! |
yuzhu
changed the title
yuzhu
changed the title
|
alluxio-bot, merge this please |
|
merge failed: |
|
alluxio-bot, merge this please |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What changes are proposed in this pull request?
This fix a bug in corrupted data files.
Previously, #17497 attempt to solve this issue but only covers the case when creating a UFS reader
Notice we only handle block reader. So this may not fix paged Block Reader in 2.x
Why are the changes needed?
Please clarify why the changes are needed. For instance,
If you propose a new API, clarify the use case for a new API.
If you fix a bug, describe the bug.
Does this PR introduce any user facing changes?
Please list the user-facing changes introduced by your change, including
change in user-facing APIs
addition or removal of property keys
[This is an auto-generated PR to cherry-pick committed PR https://github.com//pull/18525 into branch branch-2.10]