SENSEI: SoA Particle Support

[ax3l]

Summary

Add support for pure SoA layouted particle containers for SENSEI.

Additional background

Follow-up to #2878.

Checklist

The proposed changes:

• fix a bug or incorrect behavior in AMReX
• add new capabilities to AMReX
• changes answers in the test suite to more than roundoff level
• are likely to significantly affect the results of downstream AMReX users
• include documentation in the code and/or rst files, if appropriate

[ax3l]

cc @c-wetterer-nelson @patrickoleary @burlen for the discussion we had today

[burlen]

amrex::ParticleDataAdaptor will also need to be updated.

Also, since all of our particle classes are templates, and there's no instantiations inside AMReX, the CI builds don't compile them, and any bugs won't be caught there.

I think we probably need to add regression tests that create an instance and exercise it.

We've been using the tutorials and various AMReX downstream codes for testing.

[ax3l]

Thank you @atmyers 🎉

Cc @burlen ping for review

[c-wetterer-nelson]

this looks great! +1

I do appreciate the new template<typename ParticleType, ... templating. Have all the science codes successfully adopted it yet?

[burlen]

I think our exposure to this change is limited to WarpX and the AMReX tutorials. @c-wetterer-nelson would you be able to try out the tutorial and see what if any changes are needed?

[atmyers]

The CI test is compiling now - @burlen @c-wetterer-nelson do you think one of you could try this out on the tutorial?

[ax3l]

Have all the science codes successfully adopted it yet?

@c-wetterer-nelson we update step-by-step and started with the BLAST codes: WarpX, ImpactX, HiPACE++.

This PR and #3350 are still on the way for the WarpX & ImpactX transition :)

[ax3l]

This looks great, good to merge from my side! 🎉 Thank you @atmyers for all the work!
(Cannot approve since I opened it 😅)