4. Parallel Computing 14. Introduction

14.8  Distributed Memory Multiprocessors

A distributed memory multiprocessor provides an alternative to shared memory. In this

type of design, processors don't contend for a common memory. Instead, each processor

is closely linked with its own memory. Processors must communicate by sending

messages to one another. The only means for a processor to get something from another

processor's memory is for the former to send a message to the latter indicating its desire.

It is up to the receiving processor to package a response as a message back to the

requesting processor.

---

604

Parallel Computing

Processor

Processor

Processor

Processor

....

Memory

Communication 

Switch or Bus

Memory

Memory

Memory