How do we know if a parallel algorithm is successful? Quinn introduces the mathematical metrics used to evaluate efficiency: Speedup ( Spcap S sub p
Parallel computing refers to the simultaneous execution of multiple processing tasks on multiple processing units, such as CPUs, GPUs, or specialized cores. The primary goal of parallel computing is to improve the performance, efficiency, and scalability of computational tasks. With the advent of multi-core processors, parallel computing has become increasingly important in various fields, including scientific simulations, data analytics, machine learning, and more.
For clusters, MPI is the lingua franca. Quinn excels here by explaining (Single Program, Multiple Data) models. He contrasts blocking sends ( MPI_Send ) vs. non-blocking sends ( MPI_Isend ), tying those functions back to the theory of latency hiding. Classic algorithms covered include: Parallel Computing Theory And Practice Michael J Quinn Pdf
Quinn's approach in "Parallel Computing: Theory and Practice" is characterized by:
by Michael J. Quinn (2nd Edition, 1994) is a foundational textbook that bridges the gap between conceptual parallel processing and real-world algorithm implementation. Core Focus and Audience How do we know if a parallel algorithm is successful
Michael J. Quinn gave the industry a text that forces you to calculate before you compile. In the era of heterogeneous computing—where CPUs, GPUs, and TPUs work side by side—that skill is not just academic; it is the essence of high-performance computing.
In a notable shift, Dr. Quinn's focus later turned to computer ethics, leading to his widely used textbook , now in its 9th edition. Since 2007, he has served as the Dean of the College of Science and Engineering at Seattle University. With the advent of multi-core processors, parallel computing
“Parallel Computing: Theory and Practice” is the second edition of a successful project. The first edition was published in 1987 under a different title: This earlier work was itself praised as an “excellent introduction to parallel computation” that was “accessible to the undergraduate, but is also a resource for the graduate student or scholar”.