Issue 1668 - Check files have the correct jobId assigned to them in compaction job state store update#1684

Merged

kr565370 merged 37 commits intodevelopfrom 1668-check-job-files-have-job-ids-before-statestore-update

Jan 17, 2024

+687-304

Commits on Jan 16, 2024

Commits on Jan 17, 2024

Update property name to be more specific about failed jobs
kr565370
committed
Set clients explicitly in CompactSortedFilesRunner main method
kr565370
committed
Use new method signature for atomically updating files in InMemoryFileReferenceStoreTest
kr565370
committed
Use new method signature for atomically updating files in FilesStatusReportTest
kr565370
committed
Use new method signature for atomically updating files in ReinitialiseTableIT
kr565370
committed
Use new method signature for atomically updating files in CompactSortedFilesRunnerLocalStackIT
kr565370
committed
Use new method signature for atomically updating files in GarbageCollector tests
kr565370
committed
Use new method signature for atomically updating files in DynamoDBFileReferenceStoreIT
kr565370
committed
Use new method signature for atomically updating files in DynamoDBStateStoreIT
kr565370
committed
Merge branch 'develop' into 1668-check-job-files-have-job-ids-before-statestore-update
kr565370
committed
Update properties templates
kr565370
committed
Fix test failure
kr565370
committed
Use new method signature for atomically updating files in S3FileReferenceStoreIT
kr565370
committed
Use new method signature for atomically updating files in S3StateStoreIT
kr565370
committed
Remove old method signature for atomically updating files
kr565370
committed
Add test for multiple job runs in WaitForJobStatusTest
kr565370
committed
Revert to using boolean flag for in progress jobs
kr565370
committed
Refactor and revert changes
kr565370
committed
Add comment to explain why we use ParquetFileWriter.Mode.OVERWRITE
kr565370
committed
Fix incorrect firstInProgressStartTime in test
kr565370
committed
Add test for 2 jobs with 2 runs
kr565370
committed
Revert changes and fix failing tests
kr565370
committed
Handle case where an earlier run is finished in WaitForJobsStatus
patchwork01
committed
Tweak WaitForJobsStatusTest
patchwork01
committed
Merge remote-tracking branch 'origin/develop' into 1668-check-job-files-have-job-ids-before-statestore-update
patchwork01
committed