Parallel algorithms, programming languages and computers
Parallel programming is the art of writing programs for computers that perform many operations simultaneously. This essay discusses the nature of parallel programming without going into technical details. It uses a sorting problem to illustrate what it means to solve a problem in parallel, how we write parallel programs, how parallel computers execute them, and how fast they run. The author expects that scientific users of parallel computers may find ease of programming more important than maximum performance. He suggests ways to make this possible.
Hansen, Per Brinch, "The Nature of Parallel Programming" (1989). Electrical Engineering and Computer Science Technical Reports. Paper 59.