Since its release in summer 1994, the Message Passing Interface (MPI) specification has become a standard for message-passing libraries for parallel computations. There exist more than a dozen implementations on a variety of computing platforms, from the IBM SP-2 supercomputer to PCs running Windows NT.
Experts in high-speed computation agree that the rapidly growing demand for more powerful computers can only be met by a radical change in computer architecture, a change from a single serial processor to an aggregation of many processors working in parallel. At present, our knowledge about multi-processor architectures, concurrent programming or parallel algorithms is very limited. This book discusses all three subjects in relation to the HEP supercomputer that can handle multiple instruction streams and multiple data streams (MIMD).