Message Passing Interface
(MPI) is a communication protocol for parallel programming. MPI
is specifically used to allow applications to run in parallel
across a number of separate computers connected by a network.
Profiling tools are available that allow users to profile their
application/code to determine the performance of the component
routines. This can be particularly useful when designing a parallel
version of a sequential code.