Support Parquet key management tools

[adamreeve]

Follow up task to #6637 and #7111, which add support for Parquet modular encryption.

Parquet-java, C++ Parquet and PyArrow provide a higher level API on top of Parquet modular encryption to simplify integration with a key management system (KMS) and support encryption best-practices. For compatibility with these implementations and to simplify the use of Parquet encryption, arrow-rs should also support this API.

There's a design document that provides more details on this at https://docs.google.com/document/d/1bEu903840yb95k9q2X-BlsYKuXoygE4VnMDl9xz_zhk/edit?tab=t.0#heading=h.aatf1oymdx11

I have made some progress towards implementing this in a branch (https://github.com/adamreeve/arrow-rs/tree/kmt).

[AudriusButkevicius]

I guess this is not closed as needs to be weaved in for encryption?

[adamreeve]

Yes this is not done yet. I should have a PR ready for it soon.

It will be a separate module that builds on top of the recently added encryption feature.

[adamreeve]

See #7387 (comment), it was decided this should be a third party crate rather than part of arrow-rs for now, so I'm closing this as not planned. I'll update here with details once a crate is available.

[alamb]

label_issue.py automatically added labels {'parquet'} from #7286

[adamreeve]

We (G-Research) have now released a new parquet-key-management crate to implement this functionality.