Parallel Scientific Computing in C++ and MPI, George Karniadakis and Robert Kirby, Cambridge University Press, 2003, ISBN 0-521-81754-4
This book provides a good introduction to the MessagePassingInterface. It also has a lot to say about implementation of numerical methods for LinearAlgebra in CeePlusPlus.
See also ParallelProgrammingModel