Types of Parallel Computing Models

• Data Parallel - the same instructions are carried out simultaneously on multiple data items (SIMD)

• Task Parallel - different instructions on different data (MIMD)

• SPMD (single program, multiple data) not synchronized at individual operation level

• SPMD is equivalent to MIMD since each MIMD program can be made SPMD (similarly for SIMD, but not in practical sense.)

Notes: