p0 init p1 init p2 init p0 comm_size 3 p0 allReduce 5e8 5e8 p1 allReduce 5e8 5e8 p2 allReduce 5e8 5e8 p0 compute 5e8 p1 compute 5e8 p2 compute 5e8 p0 finalize p1 finalize p2 finalize