version 5.16.1 released

• [fix] Fixes syntax error on ruby 2.1

version 5.16.0 released

• [CHANGE][EXPERIMENTAL] streaming_load: Always reuse same temporary log table xxxx_l_wk instead of temporary xxxx_l_tmpNNNN. This might cause Redshift DDL slow down, I try to reduce the number of drop-create. You must create new temporary table xxxx_l_wk which has same columns as streaming load log table in advance.

version 5.15.2 released

• [fix] redis-export: remove un-required error check.

version 5.15.1 released

• [new] redis-export: make faster using cursor and Redis pipeline.

version 5.15.0 released

• [new][EXPERIMENTAL] new job class redis-export.

veresion 5.14.0 released

• [new] streaming_load: Fast log check by temporary load log table.
• [new] streaming_load: Ignores all S3 key-does-not-exist errors; they are caused by S3 eventual consistency.

version 5.13.1 released

version 5.13.1

• [fix] load, streaming_load: "encrypted" load option should not be used for SSE-KMS

version 5.13.0 released

• [new] streaming_load: Supports S3 server-side encryption with AWS KMS (Key Management Service). Add "encryption: aws:kms" option to encrypted S3 data sources.

Example (database.yml)

s3:
  type: s3
  encryption: "aws:kms"    # NEW!!
  bucket: ....

Note

• Bricolage metadata is never encrypted regardless of encryption.
• Bricolage now requires Ruby AWS-SDK v2 for AWS signature v4, this release breaks source-level compatibility.

version 5.12.5 released

• [fix] MySQL export did not work: Ruby 2.1 does not have Etc.uname, use uname command instead.

version 5.12.4 released

• [new] Supports loading from encrypted S3 data source.
• [new] New job class "createview".
• [new] Now "create" and "sql" job class support "grant" parameter.