AnOverviewoftheBSPModelofParallelComputation.pptVIP

An Overview of the BSP Model of Parallel Computation Michael C. Scherger mscherge@ Department of Computer Science Kent State University Contents Overview of the BSP Model Predictability of the BSP Model Comparison to Other Parallel Models BSPlib and Examples Comparison to Other Parallel Libraries Conclusions References “BSP: A New Industry Standard for Scalable Parallel Computing”, lab.ox.ac.uk/oucl/users/bill.mccoll/oparl.html Hill, J. M. D., and W. F. McColl, “Questions and Answers About BSP”, lab.ox.ac.uk/oucl/users/bill.mccoll/oparl.html Hill, J. M. D., et. al, “BSPlib: The BSP Programming Library”, lab.ox.ac.uk/oucl/users/bill.mccoll/oparl.html McColl, W. F., “Bulk Synchronous Parallel Computing”, Abstract Machine Models for Highly Parallel Computers, John R. Davy and Peter M. Dew eds., Oxford Science Publications, Oxford, Great Brittain, 1995, pp. 41-63. McColl, W. F., “Scalable Computing”, lab.ox.ac.uk/oucl/users/bill.mccoll/oparl.html Valiant, Leslie G., “A Bridging Model for Parallel Computation”, Communications of the ACM, Aug., 1990, Vol. 33, No. 8, pp. 103-111 The BSP Worldwide organization website is and an excellent Ohio Supercomputer Center tutorial is available at . What Is Bulk Synchronous Parallelism? Computational model of parallel computation BSP is a parallel programming model based on the Synchronizer Automata as discussed in Distributed Algorithms by Lynch. The model consists of: A set of processor-memory pairs. A communications network that delivers messages in a point-to-point manner. A mechanism for the efficient barrier synchronization for all or a subset of the processes. There are no special combining, replicating, or broadcasting facilities. What does the BSP Programming Style Look Like? Vertical Structure Sequential composition of “supersteps”. Local computation Process Communication Barrier Synchronization Horizontal Structure Concurrency among a fixed number of virtual processors. Processes do not have a particular ord