State store method to add a transaction from S3

[rtjd6554]

Background

Split from:

• Unordered batch commit queue for compaction jobs #3686

Related to:

• Add transaction type to DynamoDB item for a state store transaction held in S3 #3679

Description

We'll need to add some method on the state store to be able to add a transaction that's held in S3. This method could take the metadata that we expect to be in the SQS message and the transaction log, and also a pointer to the transaction body in S3. The state store can then read the body from S3 and apply it to the log.

Analysis

We will want the TransactionType and a pointer to the S3 data bucket for the transaction. Will be able to deserialise the transaction with the TransactionSerDe, which takes the TransactionType mentioned previous.

A new interface can be used to build the transaction object, this will be from extracting the body from S3. From this a new method will be created, similar in nature to those within TransactionLogFileReferenceStore, but instead of the transaction being created anew, it is populated from the aforementioned transaction from S3.

We'll also need to adjust the TransactionLogStore, as currently storing and loading transactions to/from S3 happens inside the implementation of that class. We can move that logic out, and operate against a separate interface to store the body of the transaction in S3. The TransactionLogEntry would also need to be adjusted to know whether the transaction body is held in S3.