Patterns for Parallel Programming, Timothy G. Mattson, Beverly A. Sanders, Berna L. Massingill
Published Sep 15, 2004 by Addison-Wesley Professional. Part of the Software Patterns Series series.
http://www.informit.com/store/product.aspx?isbn=0321228111
The authors define a PatternLanguageForParallelProgramming.
This seems to me to be a very useful book summarising much of the information needed to get going with ParallelProgramming. It helps to explain the different choices of ParallelProgrammingModel and when to use them. It covers both MessagePassingInterface (MPI) and OpenMultiProcessing (OpenMP) models. -- JohnFletcher
One of the authors, Timothy G. Mattson, has also been involved in organising ParaPlop workshops.