Skip to content

Latest commit

 

History

History
210 lines (127 loc) · 9.83 KB

CHANGELOG.md

File metadata and controls

210 lines (127 loc) · 9.83 KB
Raw

Changelog

0.7.0

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.7.0

Most notable changes

  • [USER] Added command-line options etcd-username and etcd-password to connect to etcd with username-password if necessary. (#170, @ae6rt)
  • [USER] Updated etcd vendoring version to 3.3.13. (#155, @shreyas-s-rao)
  • [USER] Full snapshot on etcd startup will now be deferred in favour of an initial delta snapshot, followed by a full snapshot and subsequent delta snapshots. (#154, @shreyas-s-rao)
  • [USER] Added functionality to trigger on-demand full snapshots via the HTTP endpoint /snapshot/full. (#143, @shreyas-s-rao)

Improvements

  • [USER] All exposed metrics are initialised to zero values. (#180, @shreyas-s-rao)
  • [USER] In the case that initial delta snapshot fails, a full snapshot is tried instead. (#165, @shreyas-s-rao)
  • [USER] Fixed the sorting of snapshots. (#161, @swapnilgm)
  • [OPERATOR] Added new flag experimental-fail-below-revision flag for initializer and /initialization/start http call (#184, @swapnilgm)
  • [OPERATOR] The health status changes are now logged at INFO level to help debug issues with etcd readiness. (#182, @amshuman-kr)
  • [OPERATOR] Etcd-backup-restore now uses the go modules for its dependecy management. (#176, @kayrus)
  • [OPERATOR] Fixed liveness probe command in helm chart. (#172, @shreyas-s-rao)
  • [OPERATOR] Optimized WAL verification memory usage. (#155, @shreyas-s-rao)
  • [OPERATOR] Reduced etcd downtime by optimizing readiness probe. (#151, @shreyas-s-rao)
  • [OPERATOR] Updated the base image of alpine in docker container to 3.9.3. (#146, @swapnilgm)

0.6.4

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.6.4

Improvements

  • [USER] In the case that initial delta snapshot fails, a full snapshot is tried instead. (#166, @swapnilgm)

0.6.3

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.6.3

Improvements

  • [USER] Fixed the sorting of snapshots. (#162, @shreyas-s-rao)

0.6.2

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.6.2

Most notable changes

  • [USER] Updated etcd vendoring version to 3.3.13. (#157, @shreyas-s-rao)
  • [USER] Full snapshot on etcd startup will now be deferred in favour of an initial delta snapshot, followed by a full snapshot and subsequent delta snapshots. (#157, @shreyas-s-rao)

Improvements

  • [OPERATOR] Optimized WAL verification memory usage. (#157, @shreyas-s-rao)

0.6.1

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.6.1

Improvements

  • [OPERATOR] Reduced etcd downtime by optimizing readiness probe. (#153, @shreyas-s-rao)
  • [OPERATOR] Updated the base image of alpine in docker container to 3.9.3. (#153, @shreyas-s-rao)

0.6.0

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.6.0

Most notable changes

  • [USER] Added the embedded-etcd-quota-bytes flag to allow configuring the backend quota size of the embedded etcd instance used during restoration of data. (#134, @shreyas-s-rao)
  • [USER] Unnecessary data validation will now be skipped, allowing for quicker etcd restarts. (#93, @georgekuruvillak)

Improvements

  • [OPERATOR] The golang version has been upgraded to v1.12.0. (#132, @ialidzhikov)
  • [OPERATOR] In case of storage provider is not configured, i.e. backup disabled, we skip the backup dependent sanity checks. (#122, @swapnilgm)

0.5.2

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.5.2

Most notable changes

  • [USER] Added the embedded-etcd-quota-bytes flag to allow configuring the backend quota size of the embedded etcd instance used during restoration of data. (#136, @swapnilgm)

0.5.1

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.5.1

Most notable changes

  • [USER] In case of storage provider is not configured, i.e. backup disabled, we skip the backup dependent sanity checks. (#123, @swapnilgm)

0.5.0

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.5.0

Most notable changes

  • [USER] Add new cloud provider OSS (Alibaba Object Storage Service) support for etcd-backup-restore (#108, @minchaow)
  • [USER] Added configurable flag delta-snapshot-memory-limit to restrict memory consumption due to periodic delta snapshots. (#84, @swapnilgm)
  • [OPERATOR] Fixed memory/goroutine leak: close previous Etcd watches (#116, @databus23)

Improvements

  • [USER] It now skips full snapshot if there were no updates on the etcd since previous full snapshot. (#86, @swapnilgm)
  • [USER] Fixed the authentication call for swift to retry authentication on token expiration by setting AllowReauth flag for swift authentication call to true. (#80, @georgekuruvillak)
  • [OPERATOR] Added the option to disable delta snapshots, by setting the 'delta-snapshot-period-seconds' flag to any value lesser than 1. (#96, @shreyas-s-rao)
  • [OPERATOR] Added a sanity check to prevent data loss during initialization, by ensuring that the etcd revision is greater than or equal to the latest snapshot revision (#85, @shreyas-s-rao)
  • [OPERATOR] Add mock test for GCS provider. (#82, @swapnilgm)
  • [OPERATOR] There is now a helm chart to deploy etcd-backup-restore. (#59, @bergerx)

0.4.1

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.4.1

Most notable changes

  • [USER] Added configurable flag delta-snapshot-memory-limit to restrict memory consumption due to periodic delta snapshots. (#84, @swapnilgm)
  • [USER] Fixed the authentication call for swift to retry authentication on token expiration by setting AllowReauth flag for swift authentication call to true. (#80, @georgekuruvillak)

0.4.0

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.4.0

Most notable changes

  • [USER] Now, snapshot upload happens in chunk. One can configure the number of parallel chunk uploads by setting command line argument max-parallel-chunk-uploads. Default is set to 5. (#68, @swapnilgm)
  • [OPERATOR] Dynamic profiling support is added. Now we expose the debug/pprof/* endpoint to dynamically profile cpu, heap consumption. To enable profiling one has to explicitly set enable-profiling on server sub-command. (#60, @swapnilgm)
  • [USER] At the time of restoration, the etcd data directory will be restored to temporary directory with suffix .part i.e.<path-to-etcd-data-dir>.part. On successful restoration we will replace actual etcd data directory with this. This brings standard and more cleaner approach to restoration. (#58, @georgekuruvillak)
  • [USER] Restoration time optimised by parallelising the fetching of delta snapshots. Added the --max-fetchers flag to the etcdbrctl command to specify the maximum number of fetcher threads that are allowed to run in parallel. (#57, @shreyas-s-rao)
  • [USER] Etcd-backup-restore utility when started in server mode will start defragmenting etcd member data directory periodically, so that db size will be under control. You can set defragmentation period in number of hours by setting defragmentation-period-in-hours flag on etcdbrctl server command. (#55, @swapnilgm)

Improvements

  • [OPERATOR] Updated the azure sdk as per the recommendation in doc to use package github.com/Azure/azure-storage-blob-go as azure storage SDK, (#76, @swapnilgm)
  • [OPERATOR] Added mock test for Openstack Swift snapstore. (#75, @swapnilgm)
  • [OPERATOR] Snapshot are now uploaded in chunks, considering only erroneous chunk upload in case of failure. (#53, @swapnilgm)

0.3.1

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.3.1

Fixed

  • Previously, in case of a failed delta snapshot, data directory was marked as valid even though there is data loss due to further delta snapshots in queue which weren't getting applied.

Added

  • Integration test for AWS:
    • Covers restoration, data directory validation and snapshotter code.

0.3.0 - 2018-06-26

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.3.0

Added

  • Incremental Backup-restore (#29):

    • In backup, full snapshot is taken first and then we apply watch and persist the logs accumulated over certain period to snapshot store.
    • Restore process, restores from the full snapshot, start the embedded etcd and apply the logged events one by one.
    • Checksum is append in delta snapshot for verification.

  • Exponential garbage collection (#31):

    • Introduces new argument:
    • Keep only the last 24 hourly backups and of all other backups only the last backup in a day
    • Keep only the last 7 daily backups and of all other backups only the last backup in a week
    • Keep only the last 4 weekly backups
    • Unit tests are added for same

  • Initial setup for Integration test for AWS

0.2.3 - 2018-05-22

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.2.3

Fixed

  • Etcd made unready in case backup container fails to take periodic backups.
  • Backup container made to retry exponentially rather than crash out.

Changed

  • Readiness probe renamed from /metrics to /healthz.

0.2.2 - 2018-04-30

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.2.2

Added

  • TLS support for etcd endpoints.

Changed

  • Delete contents of data directory instead of the directory.

0.1.0 - 2018-04-09

Docker Image: eu.gcr.io/gardener-project/gardener/etcdbrctl:0.1.0

Added

  • Take snapshot of etcd at periodic interval.
  • Save snapshot to object stores provided by AWS, Azure, GCS, Openstack and also to local disk.
  • Verify data directory of etcd for corruption before bootstrapping.
  • Restore the etcd data directory from previous snapshot.