Lesson 12
Date: 4/23/2009
Computational clusters
Linux for Engineering and IT applications
Message Passing Interface (MPI)
MPI is the standard of programming parallel applications using message passing.
Processes run on network distributed hosts and communicate by exchanging messages.
A community of communicating processes is called a
Communicator
. The default communicator is called
MPI_COMM_WORLD
.
Inside a communicator, each process is attributed a "process ID", called
rank
.
Parallel Computing Paradigms
Clustering Technologies
Message Passing Interface (MPI)
General MPI Program Structure
Point to Point Communication
MPI Standard Data Types
MPI Send/Receive example
MPI Collective Communications
Collective Communication Example
Master-Slave Task Farming
Computing Partial Sums
OpenMPI installation
MPI code compilation and run in OpenMPI
Sun Grid Engine
SGE installation
Jobs in SGE
SGE commands
References
Take me to the Course Website