> [ 0.000000] (1:p0@host0) p0 comm_size 3 0.000000
> [100.010400] (1:p0@host0) p0 allReduce 5e8 5e8 100.010400
> [100.010400] (2:p1@host1) p1 allReduce 5e8 5e8 100.010400
> [ 0.000000] (1:p0@host0) p0 comm_size 3 0.000000
> [100.010400] (1:p0@host0) p0 allReduce 5e8 5e8 100.010400
> [100.010400] (2:p1@host1) p1 allReduce 5e8 5e8 100.010400