is in charge of distributing some computational tasks to a set of
**workers** that execute them.
-.. image:: /images/tuto-masterworkers-intro.svg
+.. image:: /tuto_s4u/img/intro.svg
:align: center
We first present a round-robin version of this application, where the
whether this is a good algorithm to dispatch tasks to the workers.
This very simple setting raises many interesting questions:
-.. image:: /images/tuto-masterworkers-question.svg
+.. image:: /tuto_s4u/img/question.svg
:align: center
- Which algorithm should the master use? Or should the worker decide
concurrence and showing resource usage over a long period of time. It
was obtained with the Triva software.
-.. image:: /images/tuto-masterworkers-result.png
+.. image:: /tuto_s4u/img/result.png
:align: center
Prerequisite
............
Before your proceed, you need to :ref:`install SimGrid <install>`, a
-C++ compiler and also ``pajeng`` to visualize the traces. The provided
-code template requires cmake to compile. On Debian and Ubuntu for
-example, you can get them as follows:
+C++ compiler and also ``pajeng`` to visualize the traces. You may want
+to install `Vite <http://vite.gforge.inria.fr/>`_ to get a first
+glance at the traces. The provided code template requires cmake to
+compile. On Debian and Ubuntu for example, you can get them as
+follows:
.. code-block:: shell
- sudo apt install simgrid pajeng cmake g++
+ sudo apt install simgrid pajeng cmake g++ vite
An initial version of the source code is provided on framagit. This
template compiles with cmake. If SimGrid is correctly installed, you
``/opt/simgrid/bin/simgrid-colorizer``. If you did not install it at all,
you can find it in <simgrid_root_directory>/bin/colorize.
-.. todo::
+For a classical Gantt-Chart vizualisation, you can use `Vite
+<http://vite.gforge.inria.fr/>`_ as follows:
+
+.. code-block:: shell
+
+ ./master-workers small_platform.xml master-workers_d.xml --cfg=tracing:yes --cfg=tracing/msg/process:yes
+ vite simgrid.trace
+
+.. image:: /tuto_s4u/img/vite-screenshot.png
+ :align: center
+
+But if you want the full power to visualize SimGrid traces, you need
+to use R. As a start, you can download this `starter script
+<https://framagit.org/simgrid/simgrid/raw/master/docs/source/tuto_s4u/draw_gantt.R>`_
+and use it as follows:
+
+.. code-block:: shell
+
+ ./master-workers small_platform.xml master-workers_d.xml --cfg=tracing:yes --cfg=tracing/msg/process:yes
+ pj_dump --ignore-incomplete-links simgrid.trace | grep STATE > gantt.csv
+ Rscript draw_gantt.R gantt.csv
- Explain how to generate a Gantt-Chart with S4U and pajeng.
+It produces a ``Rplots.pdf`` with the following content:
-Lab 1: Simpler deployments
+.. image:: /tuto_s4u/img/Rscript-screenshot.png
+ :align: center
+
+
+Lab 1: Simpler Deployments
--------------------------
In the provided example, adding more workers quickly becomes a pain:
:language: xml
-Copy your ``master-workers.cpp`` into ``master-workers-exo1.cpp`` and
+Copy your ``master-workers.cpp`` into ``master-workers-lab1.cpp`` and
add a new executable into ``CMakeLists.txt``. Then modify your worker
function so that it gets its mailbox name not from the name of its
host, but from the string passed as ``args[1]``. The master will send
|api_s4u_Mailbox|_ for more details.
-Lab 2: Using the whole platform
--------------------------
+Lab 2: Using the Whole Platform
+-------------------------------
It is now easier to add a new worker, but you still has to do it
manually. It would be much easier if the master could start the
....................................
For that, the master needs to retrieve the list of hosts declared in
-the platform with :cpp:func:`simgrid::s4u::Engine::get_all_host()`.
+the platform with :cpp:func:`simgrid::s4u::Engine::get_all_hosts`.
Then, the master should start the worker processes with
:cpp:func:`simgrid::s4u::Actor::create`.
mailbox, which should be passed as parameter to the workers. This
reduces the amount of mailboxes, but prevents the master from taking
any scheduling decision. It really depends on how you want to organize
-your application and what you want to study with your simulator.
+your application and what you want to study with your simulator. In
+this tutorial, that's probably not a good idea.
Wrap up
.......
in XML instead of using a programming interface: it forces a clear
separation of concerns between things of very different nature.
-Lab 3: Fixed experiment duration
+Lab 3: Fixed Experiment Duration
--------------------------------
In the current version, the number of tasks is defined through the
.................................
Not all messages are equally informative, so you probably want to
-change most of the ``XBT_INFO`` into ``XBT_DEBUG`` so that they are hidden
-by default. You could for example show only the total number of tasks
-processed by default. You can still see the debug messages as follows:
+change some of the ``XBT_INFO`` into ``XBT_DEBUG`` so that they are
+hidden by default. For example, you may want to use ``XBT_INFO`` once
+every 100 tasks and ``XBT_DEBUG`` when sending all the other tasks. Or
+you could show only the total number of tasks processed by
+default. You can still see the debug messages as follows:
.. code-block:: shell
- ./masterworker examples/platforms/small_platform.xml deployment3.xml --log=msg_test.thres:debug
+ ./master-workers-lab3 small_platform.xml deployment3.xml --log=msg_test.thres:debug
-Lab 4: Understanding competing applications
--------------------------------------------
+Lab 4: Competing Applications
+-----------------------------
It is now time to start several applications at once, with the following ``deployment4.xml`` file.
understand which task belong to which application. To fix this, we
will categorize the tasks.
-For that, first let each master create its own category of tasks with
-@ref TRACE_category(), and then assign this category to each task using
-@ref MSG_task_set_category().
+Instead of starting the execution in one function call only with
+``simgrid::s4u::this_actor::execute(compute_cost)``, you need to
+create the execution activity, set its tracing category and then start
+it and wait for its completion, as follows:
+
+.. code-block:: cpp
+
+ simgrid::s4u::ExecPtr exec = simgrid::s4u::this_actor::exec_init(compute_cost);
+ exec->set_tracing_category(category);
+ // exec->start() is optional here as wait() starts the activity on need
+ exec->wait();
+
+You can make the same code shorter as follows:
+
+.. code-block:: cpp
+
+ simgrid::s4u::this_actor::exec_init(compute_cost)->set_tracing_category(category)->wait();
The outcome can then be visualized as a Gantt-chart as follows:
.. code-block:: shell
- ./masterworker examples/platforms/small_platform.xml deployment4.xml --cfg=tracing:yes --cfg=tracing/msg/process:yes
+ ./master-workers-lab4 small_platform.xml deployment4.xml --cfg=tracing:yes --cfg=tracing/msg/process:yes
vite simgrid.trace
.. todo::
