p Testing a simple master/slave example application handling failures
+! output sort
$ masterslave/masterslave_failure$EXEEXT --log=xbt_cfg.thres:critical --log=no_loc ${srcdir:=.}/small_platform_with_failures.xml ${srcdir:=.}/masterslave/deployment_masterslave.xml --cfg=path:${srcdir} "--log=root.fmt:[%10.6r]%e(%i:%P@%h)%e%m%n"
> [ 0.000000] (0:@) Cannot launch process 'slave' on failed host 'Fafard'
> [ 0.000000] (1:master@Tremblay) Got 5 slave(s) :
> [ 0.000000] (1:master@Tremblay) Bourassa
> [ 0.000000] (1:master@Tremblay) Tremblay
> [ 0.000000] (1:master@Tremblay) Got 20 task to process :
-> [ 0.173500] (3:slave@Jupiter) Received "Task"
-> [ 0.173500] (3:slave@Jupiter) Communication time : "0.173500"
-> [ 0.173500] (3:slave@Jupiter) Processing "Task"
-> [ 0.173500] (1:master@Tremblay) Send completed
-> [ 0.828842] (3:slave@Jupiter) "Task" done
-> [ 1.100000] (3:slave@Jupiter) Gloups. The cpu on which I'm running just turned off!. See you!
-> [ 10.173500] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Fafard'. Nevermind. Let's keep going!
-> [ 10.313960] (4:slave@Ginette) Received "Task"
-> [ 10.313960] (4:slave@Ginette) Communication time : "0.140460"
-> [ 10.313960] (4:slave@Ginette) Processing "Task"
-> [ 10.313960] (1:master@Tremblay) Send completed
-> [ 10.529832] (5:slave@Bourassa) Received "Task"
-> [ 10.529832] (5:slave@Bourassa) Communication time : "0.215872"
-> [ 10.529832] (5:slave@Bourassa) Processing "Task"
-> [ 10.529832] (1:master@Tremblay) Send completed
-> [ 10.532280] (2:slave@Tremblay) Received "Task"
-> [ 10.532280] (2:slave@Tremblay) Communication time : "0.002448"
-> [ 10.532280] (2:slave@Tremblay) Processing "Task"
-> [ 10.532280] (1:master@Tremblay) Send completed
-> [ 11.041990] (2:slave@Tremblay) "Task" done
-> [ 11.345057] (4:slave@Ginette) "Task" done
-> [ 11.560930] (5:slave@Bourassa) "Task" done
-> [ 20.532280] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Jupiter'. Nevermind. Let's keep going!
-> [ 30.532280] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Fafard'. Nevermind. Let's keep going!
-> [ 30.532280] (4:slave@Ginette) Mmh. Something went wrong. Nevermind. Let's keep going!
-> [ 30.532280] (1:master@Tremblay) Mmh. Something went wrong with 'Ginette'. Nevermind. Let's keep going!
-> [ 30.748152] (5:slave@Bourassa) Received "Task"
-> [ 30.748152] (5:slave@Bourassa) Communication time : "0.215872"
-> [ 30.748152] (5:slave@Bourassa) Processing "Task"
-> [ 30.748152] (1:master@Tremblay) Send completed
-> [ 30.750600] (2:slave@Tremblay) Received "Task"
-> [ 30.750600] (2:slave@Tremblay) Communication time : "0.002448"
-> [ 30.750600] (2:slave@Tremblay) Processing "Task"
-> [ 30.750600] (1:master@Tremblay) Send completed
-> [ 31.260310] (2:slave@Tremblay) "Task" done
-> [ 31.779250] (5:slave@Bourassa) "Task" done
-> [ 40.750600] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Jupiter'. Nevermind. Let's keep going!
-> [ 50.750600] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Fafard'. Nevermind. Let's keep going!
-> [ 50.891059] (4:slave@Ginette) Received "Task"
-> [ 50.891059] (4:slave@Ginette) Communication time : "0.140460"
-> [ 50.891059] (4:slave@Ginette) Processing "Task"
-> [ 50.891059] (1:master@Tremblay) Send completed
-> [ 51.106932] (5:slave@Bourassa) Received "Task"
-> [ 51.106932] (5:slave@Bourassa) Communication time : "0.215872"
-> [ 51.106932] (5:slave@Bourassa) Processing "Task"
-> [ 51.106932] (1:master@Tremblay) Send completed
-> [ 51.109379] (2:slave@Tremblay) Received "Task"
-> [ 51.109379] (2:slave@Tremblay) Communication time : "0.002448"
-> [ 51.109379] (2:slave@Tremblay) Processing "Task"
-> [ 51.109379] (1:master@Tremblay) Send completed
-> [ 51.619089] (2:slave@Tremblay) "Task" done
-> [ 51.922157] (4:slave@Ginette) "Task" done
-> [ 52.138029] (5:slave@Bourassa) "Task" done
-> [ 61.109379] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Jupiter'. Nevermind. Let's keep going!
-> [ 71.109379] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Fafard'. Nevermind. Let's keep going!
-> [ 71.249839] (4:slave@Ginette) Received "Task"
-> [ 71.249839] (4:slave@Ginette) Communication time : "0.140460"
-> [ 71.249839] (4:slave@Ginette) Processing "Task"
-> [ 71.249839] (1:master@Tremblay) Send completed
-> [ 71.465711] (5:slave@Bourassa) Received "Task"
-> [ 71.465711] (5:slave@Bourassa) Communication time : "0.215872"
-> [ 71.465711] (5:slave@Bourassa) Processing "Task"
-> [ 71.465711] (1:master@Tremblay) Send completed
-> [ 71.468159] (2:slave@Tremblay) Received "Task"
-> [ 71.468159] (2:slave@Tremblay) Communication time : "0.002448"
-> [ 71.468159] (2:slave@Tremblay) Processing "Task"
-> [ 71.468159] (1:master@Tremblay) Send completed
-> [ 71.468159] (1:master@Tremblay) All tasks have been dispatched. Let's tell everybody the computation is over.
-> [ 71.977869] (2:slave@Tremblay) "Task" done
-> [ 72.280937] (4:slave@Ginette) "Task" done
-> [ 72.468159] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Jupiter'. Nevermind. Let's keep going!
-> [ 72.496809] (5:slave@Bourassa) "Task" done
-> [ 73.468159] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Fafard'. Nevermind. Let's keep going!
-> [ 73.481391] (4:slave@Ginette) Received "finalize"
-> [ 73.481391] (4:slave@Ginette) I'm done. See you!
-> [ 73.501726] (5:slave@Bourassa) Received "finalize"
-> [ 73.501726] (5:slave@Bourassa) I'm done. See you!
-> [ 73.501882] (2:slave@Tremblay) Received "finalize"
-> [ 73.501882] (2:slave@Tremblay) I'm done. See you!
-> [ 73.501882] (1:master@Tremblay) Goodbye now!
-> [ 73.501882] (0:@) Simulation time 73.5019
+> [ 1.000000] (0:@) Restart processes on host: Fafard
+> [ 1.000000] (1:master@Tremblay) Mmh. Something went wrong with 'Jupiter'. Nevermind. Let's keep going!
+> [ 2.000000] (0:@) Restart processes on host: Jupiter
+> [ 11.000000] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Fafard'. Nevermind. Let's keep going!
+> [ 12.082474] (1:master@Tremblay) Send completed
+> [ 12.082474] (4:slave@Ginette) Received "Task"
+> [ 12.082474] (4:slave@Ginette) Communication time : "1.082474"
+> [ 12.082474] (4:slave@Ginette) Processing "Task"
+> [ 13.164948] (1:master@Tremblay) Send completed
+> [ 13.164948] (5:slave@Bourassa) Received "Task"
+> [ 13.164948] (5:slave@Bourassa) Communication time : "1.082474"
+> [ 13.164948] (5:slave@Bourassa) Processing "Task"
+> [ 13.175773] (1:master@Tremblay) Send completed
+> [ 13.175773] (2:slave@Tremblay) Received "Task"
+> [ 13.175773] (2:slave@Tremblay) Communication time : "0.010825"
+> [ 13.175773] (2:slave@Tremblay) Processing "Task"
+> [ 14.082474] (4:slave@Ginette) "Task" done
+> [ 14.258247] (1:master@Tremblay) Send completed
+> [ 14.258247] (6:slave@Jupiter) Received "Task"
+> [ 14.258247] (6:slave@Jupiter) Communication time : "1.082474"
+> [ 14.258247] (6:slave@Jupiter) Processing "Task"
+> [ 15.164948] (5:slave@Bourassa) "Task" done
+> [ 15.175773] (2:slave@Tremblay) "Task" done
+> [ 16.258247] (6:slave@Jupiter) "Task" done
+> [ 24.258247] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Fafard'. Nevermind. Let's keep going!
+> [ 24.258247] (1:master@Tremblay) Mmh. Something went wrong with 'Ginette'. Nevermind. Let's keep going!
+> [ 24.258247] (4:slave@Ginette) Mmh. Something went wrong. Nevermind. Let's keep going!
+> [ 25.340722] (1:master@Tremblay) Send completed
+> [ 25.340722] (5:slave@Bourassa) Received "Task"
+> [ 25.340722] (5:slave@Bourassa) Communication time : "1.082474"
+> [ 25.340722] (5:slave@Bourassa) Processing "Task"
+> [ 25.351546] (1:master@Tremblay) Send completed
+> [ 25.351546] (2:slave@Tremblay) Received "Task"
+> [ 25.351546] (2:slave@Tremblay) Communication time : "0.010825"
+> [ 25.351546] (2:slave@Tremblay) Processing "Task"
+> [ 26.434021] (1:master@Tremblay) Send completed
+> [ 26.434021] (6:slave@Jupiter) Received "Task"
+> [ 26.434021] (6:slave@Jupiter) Communication time : "1.082474"
+> [ 26.434021] (6:slave@Jupiter) Processing "Task"
+> [ 27.340722] (5:slave@Bourassa) "Task" done
+> [ 27.351546] (2:slave@Tremblay) "Task" done
+> [ 28.434021] (6:slave@Jupiter) "Task" done
+> [ 36.434021] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Fafard'. Nevermind. Let's keep going!
+> [ 37.516495] (1:master@Tremblay) Send completed
+> [ 37.516495] (1:master@Tremblay) Mmh. Something went wrong with 'Bourassa'. Nevermind. Let's keep going!
+> [ 37.516495] (4:slave@Ginette) Received "Task"
+> [ 37.516495] (4:slave@Ginette) Communication time : "1.082474"
+> [ 37.516495] (4:slave@Ginette) Processing "Task"
+> [ 37.516495] (5:slave@Bourassa) Mmh. Something went wrong. Nevermind. Let's keep going!
+> [ 37.527320] (1:master@Tremblay) Send completed
+> [ 37.527320] (2:slave@Tremblay) Received "Task"
+> [ 37.527320] (2:slave@Tremblay) Communication time : "0.010825"
+> [ 37.527320] (2:slave@Tremblay) Processing "Task"
+> [ 38.609794] (1:master@Tremblay) Send completed
+> [ 38.609794] (6:slave@Jupiter) Received "Task"
+> [ 38.609794] (6:slave@Jupiter) Communication time : "1.082474"
+> [ 38.609794] (6:slave@Jupiter) Processing "Task"
+> [ 39.516495] (4:slave@Ginette) "Task" done
+> [ 39.527320] (2:slave@Tremblay) "Task" done
+> [ 40.609794] (6:slave@Jupiter) "Task" done
+> [ 48.609794] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Fafard'. Nevermind. Let's keep going!
+> [ 49.692268] (1:master@Tremblay) Send completed
+> [ 49.692268] (4:slave@Ginette) Received "Task"
+> [ 49.692268] (4:slave@Ginette) Communication time : "1.082474"
+> [ 49.692268] (4:slave@Ginette) Processing "Task"
+> [ 50.000000] (4:slave@Ginette) Gloups. The cpu on which I'm running just turned off!. See you!
+> [ 50.774742] (1:master@Tremblay) Send completed
+> [ 50.774742] (5:slave@Bourassa) Received "Task"
+> [ 50.774742] (5:slave@Bourassa) Communication time : "1.082474"
+> [ 50.774742] (5:slave@Bourassa) Processing "Task"
+> [ 50.785567] (1:master@Tremblay) Send completed
+> [ 50.785567] (1:master@Tremblay) All tasks have been dispatched. Let's tell everybody the computation is over.
+> [ 50.785567] (2:slave@Tremblay) Received "Task"
+> [ 50.785567] (2:slave@Tremblay) Communication time : "0.010825"
+> [ 50.785567] (2:slave@Tremblay) Processing "Task"
+> [ 50.785567] (6:slave@Jupiter) Received "finalize"
+> [ 50.785567] (6:slave@Jupiter) I'm done. See you!
+> [ 51.785567] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Fafard'. Nevermind. Let's keep going!
+> [ 52.774742] (5:slave@Bourassa) "Task" done
+> [ 52.785567] (0:@) Simulation time 52.7856
+> [ 52.785567] (1:master@Tremblay) Mmh. Got timeouted while speaking to 'Ginette'. Nevermind. Let's keep going!
+> [ 52.785567] (1:master@Tremblay) Goodbye now!
+> [ 52.785567] (2:slave@Tremblay) "Task" done
+> [ 52.785567] (2:slave@Tremblay) Received "finalize"
+> [ 52.785567] (2:slave@Tremblay) I'm done. See you!
+> [ 52.785567] (5:slave@Bourassa) Received "finalize"
+> [ 52.785567] (5:slave@Bourassa) I'm done. See you!
