This page contains information on parallel computing in general, and
more specifically on parallel systems that are available on the web. This
mainly covers compilation and runtime systems for parallel computation,
focusing on declarative languages. In a broader sense it also covers
distributed computation on either local- or wide-area networks.
Relevant Courses at HWU:
F21DP: Distributed and Parallel Technologies
Related Pages: My page on Programming Languages
- "Structured Parallel Programming"
Michael McCool, James Reinders, Arch Robison.
ISBN10: 0124159931 ISBN13: 9780124159938 (paperback).
Publisher: Elsevier Science & Technology Morgan Kaufmann Publishers, 31 Jul 2012.
(a book on parallel patterns, aimed at practitioners in parallel programming, using Cilk and TBB as frameworks)
Designing and Building Parallel Programs --
Concepts and Tools for Parallel Software Engineering,
Ian T. Foster, Addison Wesley, Reading, MA, 1995.
(a good introductory on-line textbook on parallel programming)
Parallel Programming in C with MPI and OpenMP
Quinn, Michael J., 2004, McGraw Hill, ISBN: 0072822562
(standard textbook on parallel programming; mainly numerical algorithms and message passing but also OpenMP (shared-memory))
- "Foundations of Multithreaded, Parallel and Distributed Programming"
Gregory R. Andrews. Pearson, 2000. ISBN: 9780201357523.
uses the MPD language
(an older classic textbook, focussing on explicit threads and synchronisation; comes from OS and OS-level synchr. concepts; covers pthreads, MPI, OpenMP, HPF in lang. case studies)
- "Parallel Programming: Techniques and Applications Using Networked Workstations and Parallel Computers", Barry Wilkinson, Michael Allen. Second edition, Pearson, May 2004. ISBN: 0131918656.
(another recommended textbook as (under-)graduate introduction to parallelism; "exhaustively class-tested")
UPC: Distributed Shared Memory Programming,
Tarek El-Ghazawi, William Carlson, Thomas Sterling, Katherine Yelick; ISBN: 0-471-22048-5 ; Published by John Wiley and Sons- May, 2005
(main textbook on UPC and PGAS languages in general)
"Using OpenMP: Portable Shared Memory Parallel Programming"
by Barbara Chapman, Gabriele Jost and Ruud van der Pas.
MIT Press, Dec 2007. ISBN-10: 0262533022 ISBN-13: 978-0262533027 (paperback).
(a good textbook on OpenMP programming, specifically)
Parallel Programming with Microsoft .NET --- Design Patterns for Decomposition and Coordination on Multicore Architectures,
by C. Campbell, R. Johnson, A. Miller, S. Toub. Microsoft
Press. August 2010.
(pattern based parallel programming)
The Landscape of Parallel Computing Research: A View From Berkeley
A View of the Parallel Computing Landscape, CACM 2009
(an influential position paper, and a community around it)
Funded (Meta) Projects:
- Cactus, toolkit for relativity computations etc
- EGO, program for computing molecular dynamics
Newsletters and such:
VectorFabrics a company doing embedded systems and multi-core programming using functional languages
Home pages for some projects on runtime systems for parallel computation:
Programming techniques etc
Beowulf related stuff:
Mailing lists (archives)
Newsletters and such:
Info on PVM:
Info on MPI:
- Dolphin (high-speed interconnection; SCI)
Distributed Virtual Memory
Hans-Wolfgang Loidl <email@example.com>
Last modified: Mon Jan 20 18:32:41 2014