feat(pruner): Implement `full` and `bridge` node pruning by renaynay · Pull Request #3150 · celestiaorg/celestia-node

Initial implmenetation of the `full` pruner

renaynay

committed

feat: initial untested findPruneableHeaders impl, findPruneableHeaders unit tests

distractedm1nd

authored and

renaynay

committed

feat: full node pruner

distractedm1nd

authored and

renaynay

committed

refactor(pruner): making Prune signature non-variadic for easier error handling

distractedm1nd

authored and

renaynay

committed

fix(pruner/full): short-circuiting on Prune

distractedm1nd

authored and

renaynay

committed

test(pruner): Fixing expected value in TestService

distractedm1nd

authored and

renaynay

committed

feat(pruner): adding metrics

distractedm1nd

authored and

renaynay

committed

test: setting availability window to 1 day and adding full pruner to bridge

distractedm1nd

authored and

renaynay

committed

test: enabling gc

distractedm1nd

authored and

renaynay

committed

fix(pruner): add debug logs and init the failed headers map, reduce

distractedm1nd

authored and

renaynay

committed

feat(pruner): store failed headers in checkpoint + test

renaynay

committed

test(pruner): Test the pruner service, includes commit to enable block time in header test

renaynay

committed

feat(pruner): Implement retry functionality

renaynay

committed

feat(pruner): make max pruneable configurable and shorten gc cycle + increase default max pruneable

renaynay

committed

go mod tidy

renaynay

committed

feat(nodebuilder/pruner): Enable pruning with --experimental-pruning flag

renaynay

committed

chore(nodebuilder/pruner): remove stubbed out code | fix(pruner): context deadline should be per block

renaynay

committed

fix(pruner): Metrics callback unify

renaynay

committed

fix | test(pruner): Make TestService more deterministic, Make some other tests deterministic and test one more case for retries

renaynay

committed

chore(pruner): remove TODOs

renaynay

committed

fix(pruner): findPruneable also prunes genesis block, return windows to proper values, sane MaxPruneable values, return gc cycle to every 5 min

renaynay

committed

fix(pruner): Remove maxPruneablePerGC and introduce maxHeadersPerLoop

renaynay

committed

fix(pruner/full): window should be type AvailabilityWindow

renaynay

committed

fix(pruner): Do not omit `FailedHeaders` if not set

renaynay

committed

chore(pruner): extend prune ctx deadline to 5 sec instead of 1, be a bit more generous, fix log

renaynay

committed

fix(pruner): checkpoint failed map doesnt store error, UTC used for time, simplify ParseFlags

renaynay

committed

fix(pruner): remove lastPruned header from checkpoint and just use height

renaynay

committed

fix(pruner): only log actual errors from findPruneable

renaynay

committed

chore(pruner): idiomatic defer close chan

renaynay

committed

feat(pruner): change finder algo to use blockTime, remove disabledGC opt,

renaynay

committed

fix(pruner): Reduce maxHeadersPerLoop to 512

renaynay

committed

chore: lint

renaynay

committed

chore(pruner): fix comments from hlib

renaynay

committed

fix(pruner): just short-circuit when there is nothing left to prune

renaynay

committed

fix(pruner): unregister callbck from meter on stop

renaynay

committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(pruner): Implement `full` and `bridge` node pruning#3150

Commits on Mar 27, 2024

Initial implmenetation of the `full` pruner

feat: initial untested findPruneableHeaders impl, findPruneableHeaders unit tests

feat: full node pruner

refactor(pruner): making Prune signature non-variadic for easier error handling

fix(pruner/full): short-circuiting on Prune

test(pruner): Fixing expected value in TestService

feat(pruner): adding metrics

test: setting availability window to 1 day and adding full pruner to bridge

test: enabling gc

fix(pruner): add debug logs and init the failed headers map, reduce

feat(pruner): store failed headers in checkpoint + test

test(pruner): Test the pruner service, includes commit to enable block time in header test

feat(pruner): Implement retry functionality

feat(pruner): make max pruneable configurable and shorten gc cycle + increase default max pruneable

go mod tidy

feat(nodebuilder/pruner): Enable pruning with --experimental-pruning flag

chore(nodebuilder/pruner): remove stubbed out code | fix(pruner): context deadline should be per block

fix(pruner): Metrics callback unify

fix | test(pruner): Make TestService more deterministic, Make some other tests deterministic and test one more case for retries

chore(pruner): remove TODOs

fix(pruner): findPruneable also prunes genesis block, return windows to proper values, sane MaxPruneable values, return gc cycle to every 5 min

fix(pruner): Remove maxPruneablePerGC and introduce maxHeadersPerLoop

fix(pruner/full): window should be type AvailabilityWindow

fix(pruner): Do not omit `FailedHeaders` if not set

chore(pruner): extend prune ctx deadline to 5 sec instead of 1, be a bit more generous, fix log

fix(pruner): checkpoint failed map doesnt store error, UTC used for time, simplify ParseFlags

fix(pruner): remove lastPruned header from checkpoint and just use height

fix(pruner): only log actual errors from findPruneable

chore(pruner): idiomatic defer close chan

feat(pruner): change finder algo to use blockTime, remove disabledGC opt,

fix(pruner): Reduce maxHeadersPerLoop to 512

chore: lint

chore(pruner): fix comments from hlib

fix(pruner): just short-circuit when there is nothing left to prune

fix(pruner): unregister callbck from meter on stop