24 init 1 24 compute 127155 24 compute 2652 24 compute 336729 24 compute 13041221 24 comm_size 32 24 bcast 1 24 compute 25799 24 barrier 24 compute 22534 24 comm_size 32 24 bcast 1 24 compute 23738 24 barrier 24 compute 22692 24 comm_size 32 24 bcast 1 24 compute 23582 24 barrier 24 compute 22610 24 comm_size 32 24 bcast 1 24 compute 23666 24 barrier 24 compute 22696 24 comm_size 32 24 bcast 1 24 compute 23699 24 barrier 24 compute 22768 24 comm_size 32 24 bcast 1 24 compute 23666 24 barrier 24 compute 22556 24 comm_size 32 24 bcast 1 24 compute 23438 24 barrier 24 compute 426 24 barrier 24 compute 165803 24 barrier 24 compute 19099800 24 barrier 24 compute 97251 24 comm_size 32 24 bcast 1 24 compute 378293 24 barrier 24 compute 12857 24 comm_size 32 24 bcast 1 24 compute 46339 24 barrier 24 compute 1017321 24 barrier 24 compute 124220 24 gather 795 795 0 24 compute 244917352 24 allToAll 1746 1746 24 compute 276028 24 barrier 24 compute 409313728 24 comm_size 32 24 allreduce 32 20511086 1 24 compute 3038169943 24 compute 1525 24 allToAllV 13262850 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414450 414450 414450 13097094 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 386834 386834 386834 386834 386834 386834 386834 24 compute 1058646440 24 barrier 24 compute 7748 24 compute 332 24 allToAllV 13097094 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 386834 386834 386834 386834 386834 386834 386834 13262850 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414465 414450 414450 414450 24 compute 915154401 24 barrier 24 compute 1441883451 24 allToAll 13824 13824 24 compute 72648998 24 allToAll 13824 13824 24 compute 20518690 24 comm_size 32 24 allreduce 1 10902682 24 compute 1370730665 24 comm_size 32 24 allreduce 795 61540948 24 compute 1484080041 24 comm_size 32 24 allreduce 2 60816736 24 compute 21532130 24 allToAll 13824 13824 24 compute 72648997 24 allToAll 13824 13824 24 compute 20518693 24 comm_size 32 24 allreduce 1 2120822 24 compute 56435059 24 comm_size 32 24 allreduce 32 5105979 1 24 compute 60481270241 24 finalize