[support bundle] Add health checks to support bundles

[smklein]

Mostly fixes #8073

Does not completely cover the existing health check, but covers most of the cases

[leftwo]

Is there a way we could run these health checks outside of the support bundle gathering?
Or, does that require making a stand-alone version (which is fine, just want to know how).

Ideally we can transition the current bash health check script into using this, so we only have
(as much as is possible) a single place that gathers the data we want.

[papertigers]

Is there a way we could run these health checks outside of the support bundle gathering? Or, does that require making a stand-alone version (which is fine, just want to know how).

Ideally we can transition the current bash health check script into using this, so we only have (as much as is possible) a single place that gathers the data we want.

That's why we ended up with the sled-diagnostics crate which would allow you to call whatever you would like outside of support bundle gathering. The crate could include a binary if that would be helpful that could expose common things such as the health check commands. How does the health check script make it onto a sled today?

[leftwo]

Is there a way we could run these health checks outside of the support bundle gathering? Or, does that require making a stand-alone version (which is fine, just want to know how).
Ideally we can transition the current bash health check script into using this, so we only have (as much as is possible) a single place that gathers the data we want.

That's why we ended up with the sled-diagnostics crate which would allow you to call whatever you would like outside of support bundle gathering. The crate could include a binary if that would be helpful that could expose common things such as the health check commands.

Perfect. I don't think we need to hold this PR for that though, and perhaps I can do the work for this myself :)

How does the health check script make it onto a sled today?

It's copied over manually. Someday it would be nice if we did not need to do that at all and could just use the same tool to gather data and not have to update two copies.

There may always be one off things we need to do, or updates that the new software has that the old does not, but we can at least try to have a single source for some of this :)