SP2 Programming Tip
The decision on whether or not to duplicate data structures should be
decided after considering the following:
- Does the amount of time required to broadcast the data structure to
every task exceed the amount of time required to compute that data
structure locally at each task?
This exposes a common tradeoff in parallel computing; computation
vs. communication.
To help make this decision, we've tabulated the run times for various MPI
communication operations in terms of CPU cycles per word (32 bits) of
data: