A List of Terms to Consider Adding. Sharding Reduction Scatter Gather Broadcast Distributed computing Heterogeneous computing Speedup Interconnection topology Thread Barriers Blocking