Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf: various improvements in pusher, pushsync, salud, reacher #4958

Open
wants to merge 11 commits into
base: master
Choose a base branch
from

Conversation

istae
Copy link
Member

@istae istae commented Jan 23, 2025

Checklist

  • I have read the coding guide.
  • My change requires a documentation update, and I have done it.
  • I have added tests to cover my changes.
  • I have filled out the description and linked the related issues.

Description

  1. Minor clean up in reacher.go and increased go worker count
  2. Light nodes error out if a reserve capacity doubling is set in the config
  3. in the pusher, as an optimization, instead of a full stamp validation which is expense, we instead only check if the batch is still alive. Also increased max parallel push count from 100 to 128.
  4. in the pushsync protocol, forward nodes no long perform receipt validation. Also, for the shallow receipts check, we apply some tolerance to the proximity of the store node and chunk based on the maximum allowed reserve doubling. Tag reporting was also being made for direct uploads, this is has been changed to only happen for deferred uploads by checking the chunk's tag ID.
  5. In the salud service, we sort the peer list in desc order by protocol response duration so that the faster peers are given priority if a bin's population drops below the salud threshold.
  6. increased max allowed cache worker count from 16 to 128.
  7. as an optimization, the kademlia closest peer terminates early if the iterator has already a closest peer and the current bin count is greater than the chunk's proximity with the node's address.

Open API Spec Version Changes (if applicable)

Motivation and Context (Optional)

Related Issue (Optional)

Screenshots (if appropriate):

@istae istae marked this pull request as ready for review January 27, 2025 22:43
@istae istae requested a review from acha-bill as a code owner January 27, 2025 22:43
@istae istae changed the title fix: various improvements in pusher, pushsync, salud, reacher perf: various improvements in pusher, pushsync, salud, reacher Jan 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants