Parallel programming resources for Heat

[ClaudiaComito]

Thanks again @Mystic-Slice for the questions about parallel computing resources.

Very generally speaking, Heat functions and algorithms are made up of:

• process-local operations (torch operations on tensors)
• when necessary, communication among processes via the Message Passing Interface (MPI) protocol (MPI bindings for Python via mpi4py)

Understanding MPI

My favourite resources to grasp parallel computing and MPI:

• @davidhenty 's course
• Wes Kendall's tutorials

mpi4py

• tutorial

(will keep adding to this this as necessary)