18 init 1 18 compute 127155 18 compute 2652 18 compute 336725 18 compute 13041219 18 comm_size 32 18 bcast 1 18 compute 25799 18 barrier 18 compute 22474 18 comm_size 32 18 bcast 1 18 compute 23738 18 barrier 18 compute 22692 18 comm_size 32 18 bcast 1 18 compute 23582 18 barrier 18 compute 22610 18 comm_size 32 18 bcast 1 18 compute 23666 18 barrier 18 compute 22696 18 comm_size 32 18 bcast 1 18 compute 23699 18 barrier 18 compute 22768 18 comm_size 32 18 bcast 1 18 compute 23666 18 barrier 18 compute 22556 18 comm_size 32 18 bcast 1 18 compute 23438 18 barrier 18 compute 426 18 barrier 18 compute 165806 18 barrier 18 compute 17476261 18 barrier 18 compute 97251 18 comm_size 32 18 bcast 1 18 compute 378286 18 barrier 18 compute 12856 18 comm_size 32 18 bcast 1 18 compute 46338 18 barrier 18 compute 1017295 18 barrier 18 compute 124220 18 gather 795 795 0 18 compute 245938721 18 alltoall 1746 1746 18 compute 276028 18 barrier 18 compute 409314088 18 comm_size 32 18 allreduce 32 25414757 1 18 compute 3038128233 18 compute 1525 18 alltoallv 13262850 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414450 414450 414450 13097094 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 386834 386834 386834 386834 386834 386834 386834 18 compute 1058646229 18 barrier 18 compute 7563 18 compute 332 18 alltoallv 13097094 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 386834 386834 386834 386834 386834 386834 386834 13262850 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414450 414450 414450 18 compute 915154213 18 barrier 18 compute 1447518376 18 alltoall 13824 13824 18 compute 72648622 18 alltoall 13824 13824 18 compute 20518479 18 comm_size 32 18 allreduce 1 11692905 18 compute 1376442859 18 comm_size 32 18 allreduce 795 70015898 18 compute 1495165972 18 comm_size 32 18 allreduce 2 77379595 18 compute 21530774 18 alltoall 13824 13824 18 compute 72648820 18 alltoall 13824 13824 18 compute 20517985 18 comm_size 32 18 allreduce 1 5117785 18 compute 73632276 18 comm_size 32 18 allreduce 32 3373668 1 18 compute 60481274381 18 finalize