MPI Message Passing Interface. Outline Background Message Passing MPI Group and Context Communication Modes Blocking/Non-blocking Features Programming.