Brainstorm plan for shared tooling and PUDL scaling

[zschira]

Background

There are many types of tasks we do regularly in various contexts like archiving data, developing ETL's based on dagster, extracting data from obscure formats, etc. These are things we do for PUDL, as well as in unrelated client projects, which leads to us regularly reinventing the wheel and doing the same types of tasks in slightly different ways. We also have upcoming projects on the horizon that would push the boundaries of our current infrastructural capabilities like FERC EQR integration, or integrating SEC10k extraction more deeply into our nightly builds.

This issue will track the creation of a document that can be presented to the team to develop a shared plan for our future infrastructure development.

Success Criteria

Present first draft of planning document in PUDL huddle.