Parallel Programming with MPI

Exercise material and model answers for the CSC course "Parallel Programming with MPI". The course is part of PRACE Training Center (PTC) activity at CSC.

Exercises

General instructions

Introduction to MPI

• Hello world

Simple point-to-point communication

• Message exchange
• Simple parallel pi

Using special MPI variables

• Message chain
• Parallel pi
• (Bonus) Heat equation solver

Communication patterns

• Message chain with Sendrecv
• Broadcast and scatter
• (Bonus) Sendrecv in Heat equation solver

Collective communication

• Collective operations
• (Bonus) Collective communication in Heat equation solver

Non-blocking communication

• Non-blocking message chain
• (Bonus) Non-blocking communication in Heat equation solver