Role of Synchronization
“A parallel computer is a collection of processing elements that cooperate and communicate to solve large problems fast.”
Types of Synchronization
- Mutual Exclusion
- Event synchronization
- point-to-point
- group
- global (barriers)
How much hardware support?
- high-level operations?
- atomic instructions?
- specialized interconnect?