[WIP] Microbatch parallelism

[MichelleArk]

Resolves #

Problem

Solution

Checklist

• I have read the contributing guide and understand what's expected of me.
• I have run this code in development, and it appears to resolve the stated issue.
• This PR includes tests, or tests are not required or relevant for this PR.
• This PR has no interface changes (e.g., macros, CLI, logs, JSON artifacts, config files, adapter interface, etc.) or this PR has already received feedback and approval from Product or DX.
• This PR includes type annotations for new and modified functions.

[github-actions]

Thank you for your pull request! We could not find a changelog entry for this change. For details on how to document a change, see the contributing guide.

[codecov]

Codecov Report

Attention: Patch coverage is 28.46154% with 93 lines in your changes missing coverage. Please review.

Project coverage is 83.22%. Comparing base (289d2dd) to head (9e56650).
Report is 8 commits behind head on main.

❗ There is a different number of reports uploaded between BASE (289d2dd) and HEAD (9e56650). Click for more details.

HEAD has 20 uploads less than BASE

Flag	BASE (289d2dd)	HEAD (9e56650)
unit	4	0
integration	20	4

Additional details and impacted files

@@            Coverage Diff             @@
##             main   #10958      +/-   ##
==========================================
- Coverage   89.13%   83.22%   -5.91%     
==========================================
  Files         183      183              
  Lines       23552    23643      +91     
==========================================
- Hits        20993    19677    -1316     
- Misses       2559     3966    +1407     

Flag	Coverage Δ
integration	83.22% <28.46%> (-3.28%)	⬇️
unit	?

Flags with carried forward coverage won't be shown. Click here to find out more.

Components	Coverage Δ
Unit Tests	83.22% <28.46%> (-5.91%)	⬇️
Integration Tests	83.22% <28.46%> (-3.28%)	⬇️