Local Docker deployment does not run created compaction jobs

[patchwork01]

Description

We have some scripts to deploy Sleeper to Docker with LocalStack, and create and run compactions in that local instance.

Since we added the compaction job dispatch lambda, the scripts to run compactions no longer work. There is no pending queue deployed, so CreateCompactionJobs fails to send batches to be processed by the dispatch lambda.

Steps to reproduce

1. Run scripts/deploy/localstack/startContainer.sh, follow the instructions in the output to point to LocalStack
2. Run scripts/deploy/localstack/deploy.sh <instance-id>
3. Run scripts/deploy/localstack/createCompactionJobs.sh <instance-id>
4. See error as pending compaction queue does not exist

Expected behaviour

Compaction jobs should be created correctly.

A compaction task should run the jobs when invoked with scripts/deploy/localstack/runCompactionTash.sh.

We could handle this by adding an instance/table property for CreateCompactionJobs to put jobs on the compaction queue directly, and enable this for all LocalStack deployments.

We could test this in a DSL-based test with LocalStackDslTest.

We can also remove the note from the documentation that was added in the following issue:

• Document known issue with compaction on LocalStack #3869