Reducing Extra Work
Common sources of extra work:
- Computing a good partition
- e.g. partitioning in Barnes-Hut or sparse matrix
- Using redundant computation to avoid communication
- Task, data and process management overhead
- applications, languages, runtime systems, OS
- Imposing structure on communication
- coalescing messages, allowing effective naming
Architectural Implications:
- Reduce need by making communication and orchestration efficient