Rust integration tests for DataFusion compaction

[patchwork01]

Background

Follows on from:

• Test coverage for Rust compaction from Java #2850

We're also adding bulk export, which we may implement in DataFusion. A setup for integration testing in Rust could make this significantly easier:

• First version of bulk export capability #3446

Description

We'd like integration test coverage for DataFusion compaction from Rust, without needing to run any Java code.

It should be much easier to work with if we rely on tests from Rust while developing the Rust code.

Analysis

We can design this setup with bulk export in mind.

We can make sure the tests get run in GitHub Actions. We haven't seen a failure in Rust unit or integration tests yet.