[Fix](flexible partial update) Fix some problems in flexible partial update #41701
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Thank you for your contribution to Apache Doris. Since 2024-03-18, the Document has been moved to doris-website. |
|
run buildall |
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
|
TeamCity be ut coverage result: |
bobhan1
force-pushed
the
handle-delete-in-one-batch-for-flexible-partial-update
branch
from
24069a4 to
378ef2f
Compare
bobhan1
force-pushed
the
handle-delete-in-one-batch-for-flexible-partial-update
branch
from
d21f1b1 to
d2e1b4c
Compare
bobhan1
force-pushed
the
handle-delete-in-one-batch-for-flexible-partial-update
branch
3 times, most recently
from
6428fa3 to
f177418
Compare
|
run buildall |
|
TeamCity be ut coverage result: |
|
run buildall |
TPC-H: Total hot run time: 40999 ms |
|
TeamCity be ut coverage result: |
TPC-DS: Total hot run time: 192400 ms |
ClickBench: Total hot run time: 32.6 s |
bobhan1
force-pushed
the
handle-delete-in-one-batch-for-flexible-partial-update
branch
from
79fe26c to
02cb8af
Compare
|
run buildall |
|
TeamCity be ut coverage result: |
TPC-H: Total hot run time: 40756 ms |
TPC-DS: Total hot run time: 192006 ms |
ClickBench: Total hot run time: 33.62 s |
dataroaring
reviewed
Oct 14, 2024
dataroaring
reviewed
Oct 14, 2024
…ict in publish phase
…ockAggregator::aggregate_rows
…ence column may decrease (apache#198) * fix partial update that will cause seq col value not increasing problem * fix flexible partial update that will cause seq col value not increasing problem * fix existing case
… the previous row is deleted in partial update and flexible partial update when doing alignment (apache#206) * only read seq col and seq map col from old rows if old rows if deleted when do alignment for flexible partial update * let partial update only read seq col if the previous row is deleted in flush phase * add flexible partial update publish case * fix partial update publish and add caser
…is not consistent between replicas (apache#207) * add reproduce case * fix and update case * fix auto-increment value not consistent between replicas * add case
bobhan1
force-pushed
the
handle-delete-in-one-batch-for-flexible-partial-update
branch
from
c9f2159 to
9cc0eab
Compare
|
run buildall |
TPC-H: Total hot run time: 32706 ms |
TPC-DS: Total hot run time: 189531 ms |
ClickBench: Total hot run time: 30.77 s |
|
TeamCity be ut coverage result: |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
In the above situation, we should keep those rows and don't merge them when doing aggregation in memtable. When flush the memtable to segment, we should first apply the semantic of delete if exists and then insert the row after it.