MPI

Category: Parallelism · Status: stub

One line: The Message Passing Interface: separate processes, often on separate machines, exchanging messages — the standard for distributed-memory parallel programs.

Also called: Message Passing Interface.

How it connects

flowchart LR
  n_message_passing["Message passing"]
  n_mpi["MPI"]
  n_process["Process"]
  n_mpi -->|uses| n_message_passing
  n_mpi -->|uses| n_process
  classDef center stroke-width:3px
  class n_mpi center
  classDef outside stroke-dasharray: 4 3
  class n_message_passing,n_process outside

• Is built on: Message passing, Process

Where to read more

• In the books: Mastering C++ Multithreading, Maya Posch — ch. 9, 'Multithreading with Distributed Computing' → 'Installing Open MPI'
• In the books: Parallel Computing for Bioinformatics and Computational Biology, Albert Y. Zomaya (editor) — ch. 2, 'Parallel Monte Carlo Simulation of HIV Molecular Evolution in Response to Immune Surveillance' → 'Parallelization with MPI'
• In the books: An Introduction to Parallel Programming, Peter S. Pacheco, Matthew Malensek — ch. 3, 'Distributed memory programming with MPI'
• Reference: MPI Forum ↗