5 init 1 5 compute 127149 5 compute 2652 5 compute 337081 5 compute 12998946 5 comm_size 32 5 bcast 1 5 compute 25816 5 barrier 5 compute 22488 5 comm_size 32 5 bcast 1 5 compute 24027 5 barrier 5 compute 22602 5 comm_size 32 5 bcast 1 5 compute 23751 5 barrier 5 compute 22524 5 comm_size 32 5 bcast 1 5 compute 23829 5 barrier 5 compute 22604 5 comm_size 32 5 bcast 1 5 compute 23866 5 barrier 5 compute 22682 5 comm_size 32 5 bcast 1 5 compute 23839 5 barrier 5 compute 22621 5 comm_size 32 5 bcast 1 5 compute 23546 5 barrier 5 compute 421 5 barrier 5 compute 167880 5 barrier 5 compute 19577923 5 barrier 5 compute 97157 5 comm_size 32 5 bcast 1 5 compute 378019 5 barrier 5 compute 12633 5 comm_size 32 5 bcast 1 5 compute 46295 5 barrier 5 compute 1019156 5 barrier 5 compute 123092 5 gather 795 795 0 5 compute 234047138 5 allToAll 1746 1746 5 compute 276029 5 barrier 5 compute 409270813 5 comm_size 32 5 allreduce 32 26075048 1 5 compute 3038108674 5 compute 1525 5 alltoallv 13262850 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414450 414450 414450 13097094 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 386834 386834 386834 386834 386834 386834 386834 5 compute 1058646347 5 barrier 5 compute 7748 5 compute 332 5 alltoallv 13097094 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 386834 386834 386834 386834 386834 386834 386834 13262850 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414450 414450 414450 5 compute 915154397 5 barrier 5 compute 1453660307 5 allToAll 13824 13824 5 compute 72648498 5 allToAll 13824 13824 5 compute 20518451 5 comm_size 32 5 allreduce 1 9630351 5 compute 1382506563 5 comm_size 32 5 allreduce 795 86398358 5 compute 1513570165 5 comm_size 32 5 allreduce 2 82995562 5 compute 21531740 5 allToAll 13824 13824 5 compute 72648502 5 allToAll 13824 13824 5 compute 20518455 5 comm_size 32 5 allreduce 1 5339502 5 compute 56257081 5 comm_size 32 5 allreduce 32 5420716 1 5 compute 62566097632 5 finalize