Distributed memory is a concept used in parallel computing. It means that in a multi-processor system each processor has it's own memory. This requires that computional tasks have to be distributed on the different processors for processing. After the processing the data has to be reassembled.