Parallel Computing

This page contains information on parallel computing in general, and more specifically on parallel systems that are available on the web. This mainly covers compilation and runtime systems for parallel computation, focusing on declarative languages. In a broader sense it also covers distributed computation on either local- or wide-area networks.

Quick Links

Relevant Courses at HWU: F21DP: Distributed and Parallel Technologies

Related Pages: My page on Programming Languages

Textbooks etc

Textbooks etc:

• "Structured Parallel Programming" Michael McCool, James Reinders, Arch Robison.
  ISBN10: 0124159931 ISBN13: 9780124159938
  Publisher: Elsevier Science & Technology Morgan Kaufmann Publishers In Format: Paperback Publication date: 31 Jul 2012
• Designing and Building Parallel Programs -- Concepts and Tools for Parallel Software Engineering, Ian T. Foster, Addison Wesley, Reading, MA, 1995. (a good introductory on-line textbook on parallel programming)
• Parallel Programming in C with MPI and OpenMP Quinn, Michael J., 2004, McGraw Hill, ISBN: 0072822562 (standard textbook on parallel programming; mainly numerical algorithms and message passing but also OpenMP (shared-memory))
• UPC: Distributed Shared Memory Programming, Tarek El-Ghazawi, William Carlson, Thomas Sterling, Katherine Yelick; ISBN: 0-471-22048-5 ; Published by John Wiley and Sons- May, 2005 (main textbook on UPC and PGAS languages in general)
• Parallel Programming with Microsoft .NET --- Design Patterns for Decomposition and Coordination on Multicore Architectures, by C. Campbell, R. Johnson, A. Miller, S. Toub. Microsoft Press. August 2010. (pattern based parallel programming)
• The Landscape of Parallel Computing Research: A View From Berkeley (an influential position paper, and a community around it)
  A View of the Parallel Computing Landscape, CACM 2009

Surveys/Portals:

• Multi Core Info
• Survey on Grids and Metacomputing
• Meta- and Grid-Computing Sites

Grid computing:

• Grid Computing
• Globus home page
• UNICORE home page
• Sun's Grid Engine
• Cluster Computing Homepage (portal)
• Harness project
• Legion project
• Condor project
• Prospero Resource Manager
• Maui project
• Linux Virtual Server Project (load balancing on clusters)
• Microsoft Millenium project
• Piranha
• Globe project
• MILAN Metacomputing in Large Asynchronous Networks (including Calypso for load sharing)

Cloud computing:

• HPC in the Cloud
• CloudResearch (Jisc) (Elvira)
• St Andrews Cloud
• Rackspace (commercial cloud provider)

Funded (Meta) Projects:

• VenusC
• Core Grid
• D-Grid
• The European DataGrid Project
• The EuroGrid Project
• GRIDSTART

Computing Centers:

• EPCC (Hector)
• LRZ Munich
• GridKa Grid Forschungszentrum Karlsruhe
• Zuse Institute Berlin
• GRAIL Lab
• Network Weather Service Site

Conferences:

• HPDC'02 High Performance Distributed Computing (GGF)
• CCGrid 2002 IEEE International Symposium on Cluster Computing and the Grid
• CCGRID 2001 Conference
• EuroPar Series

Applications:

• Cactus, toolkit for relativity computations etc
• ROOT
• EGO, program for computing molecular dynamics

Newsletters and such:

• Grid Today
• TOP 500 list of supercomputers

Articles:

• Hackathons
• Economist article on parallelism
• Why CPU frequency stalled
• Cluster performance
• Barrelfish
• Intel concurrent collections for Haskell
• Intel Thread Building blocks (TBBs for Haskell)

Videos etc:

• Amdahl's Law

ToCheck:

• VectorFabrics a company doing embedded systems and multi-core programming using functional languages

Parallel Systems

Home pages for some projects on runtime systems for parallel computation:

• The pHluid System Home Page ( Rishiyur S. Nikhil)
• The Cid System Home Page ( Rishiyur S. Nikhil)
• pH home page ( MIT Laboratory for Computer Science, papers)
• StarT-the Next Generation ( MIT Laboratory for Computer Science, papers)
• μSystem
• Concurrent Clean (papers)
• Publications on the Cilk system. (Cilk+)
• Split-C
• The Concert system.
• Charm papers)
• Publications on the Orca system.
• Jade
• Score system for cluster computing from Tsukuba Univ, Tokyo
• Split-C
• Titanium
• Filaments

Programming techniques etc

• ACM article on (software) transactional memory
• VELOX, EU-funded project for hardware-acceleration of STM
• StreamIt
• Chapel

Beowulf related stuff:

• GAMMA a fast communication library for Beowulf clusters based on a patched Linux kernel.
• Distributed Shared Memory Pages
• UK's Memory Management Network
• Beowulf papers

Mailing lists (archives)

• Beowulf
• Globus-related lists

Newsletters and such:

• HPCwire
• Dr Dobbs parallel programming micro-site
• The Free Lunch is over, Dr Dobbs article on multi-core becoming main-stream

Info on PVM:

• PVM Home Page
• Netlib server (UK mirror)
• PVM Book
• Advanced Tutorial on PVM 3.4

Info on MPI:

• MPI

OpenMP:

• OpenMP (official web page)
• Intro to OpenMP
• Parallel Programming in OpenMP (book)

Companies

• Dolphin (high-speed interconnection; SCI)

Parallel Languages

• X10 (IBM)
• Fortress (Sun)
• Chapel (Cray)
• Skeletons Home Page (eSkel Page)
• Maude
• ELAN
• CafeOBJ

Distributed Virtual Memory

• Distributed Shared Memory Home Pages (portal)
• Phosphorus