Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(pageserver): race between gc-compaction and repartition #10127

Merged
merged 3 commits into from
Dec 13, 2024

Conversation

skyzh
Copy link
Member

@skyzh skyzh commented Dec 12, 2024

Problem

close #10124

gc-compaction split_gc_jobs is holding the repartition lock for too long time.

Summary of changes

  • Ensure split_gc_compaction_jobs drops the repartition lock once it finishes cloning the structures.
  • Update comments.

@skyzh skyzh requested a review from a team as a code owner December 12, 2024 20:26
Copy link

github-actions bot commented Dec 12, 2024

7121 tests run: 6824 passed, 0 failed, 297 skipped (full report)


Flaky tests (3)

Postgres 17

Postgres 14

  • test_physical_replication_config_mismatch_max_locks_per_transaction: release-x86-64

Code coverage* (full report)

  • functions: 31.4% (8398 of 26778 functions)
  • lines: 48.0% (66621 of 138651 lines)

* collected from Rust tests only


The comment gets automatically updated with the latest test results
8cff9da at 2024-12-13T18:17:54.019Z :recycle:

pageserver/src/tenant/timeline.rs Outdated Show resolved Hide resolved
@skyzh skyzh enabled auto-merge December 13, 2024 16:10
@skyzh skyzh added this pull request to the merge queue Dec 13, 2024
Merged via the queue into main with commit 7ee5dca Dec 13, 2024
87 checks passed
@skyzh skyzh deleted the skyzh/gc-compaction-race branch December 13, 2024 18:23
github-merge-queue bot pushed a commit that referenced this pull request Dec 18, 2024
…tests (#10164)

## Problem

part of #9114

In #10127 we fixed the race,
but we didn't add the errors to the allowlist.

## Summary of changes

* Allow repartition errors in the gc-compaction smoke test.

I think it might be worth to refactor the code to allow multiple threads
getting a copy of repartition status (i.e., using Rcu) in the future.

Signed-off-by: Alex Chi Z <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

gc-compaction: race on repartition
2 participants