Logo AND Algorithmique Numérique Distribuée

Public GIT Repository
simgrid.git
2 years agoconvert a simdag test to s4u DAGs
SUTER Frederic [Wed, 22 Dec 2021 16:36:30 +0000 (17:36 +0100)]
convert a simdag test to s4u DAGs

2 years agoimprove dag-comm example
SUTER Frederic [Wed, 22 Dec 2021 13:44:30 +0000 (14:44 +0100)]
improve dag-comm example

2 years agoenable sendto_init()->set_from(h1)->set_to(h2)
SUTER Frederic [Wed, 22 Dec 2021 13:43:49 +0000 (14:43 +0100)]
enable sendto_init()->set_from(h1)->set_to(h2)

2 years agoadd new exemple of dag with comm
SUTER Frederic [Wed, 22 Dec 2021 12:32:06 +0000 (13:32 +0100)]
add new exemple of dag with comm

2 years agofix performance issue in simdag tests
SUTER Frederic [Wed, 22 Dec 2021 11:57:30 +0000 (12:57 +0100)]
fix performance issue in simdag tests

2 years agofactor call to complete for done activities
SUTER Frederic [Wed, 22 Dec 2021 10:50:40 +0000 (11:50 +0100)]
factor call to complete for done activities

2 years agoCI: debian:testing now needs an entry point too
Martin Quinson [Wed, 22 Dec 2021 10:50:07 +0000 (11:50 +0100)]
CI: debian:testing now needs an entry point too

2 years agoActivity refactoring
SUTER Frederic [Wed, 22 Dec 2021 10:18:22 +0000 (11:18 +0100)]
Activity refactoring

Move on_completion signal, complete method, and actor_ + piface_ field
from Exec/Comm/Io to Actitity.

this implies to modifies all the callbacks on Exec::on_completion to
filter out other types of activities

2 years agoassociate a s4u::Comm to a kernel::activity::CommImpl (partial set for now because...
SUTER Frederic [Wed, 22 Dec 2021 08:11:49 +0000 (09:11 +0100)]
associate a s4u::Comm to a kernel::activity::CommImpl (partial set for now because of old simcalls)

2 years agoTiny simplifications now that we have a ActorImpl::is_maestro
Martin Quinson [Wed, 22 Dec 2021 10:07:30 +0000 (11:07 +0100)]
Tiny simplifications now that we have a ActorImpl::is_maestro

2 years agoInline another function, in EngineImpl::shutdown
Martin Quinson [Wed, 22 Dec 2021 00:43:22 +0000 (01:43 +0100)]
Inline another function, in EngineImpl::shutdown

2 years agoImplement a (cheap) ActorImpl::is_maestro()
Martin Quinson [Wed, 22 Dec 2021 00:39:09 +0000 (01:39 +0100)]
Implement a (cheap) ActorImpl::is_maestro()

2 years agoMC: chop chop chop
Martin Quinson [Tue, 21 Dec 2021 23:15:05 +0000 (00:15 +0100)]
MC: chop chop chop

2 years agomc: inline a function
Martin Quinson [Tue, 21 Dec 2021 22:49:23 +0000 (23:49 +0100)]
mc: inline a function

2 years agomc: Kill dead code
Martin Quinson [Tue, 21 Dec 2021 22:37:57 +0000 (23:37 +0100)]
mc: Kill dead code

2 years agohey pip!
SUTER Frederic [Tue, 21 Dec 2021 16:22:09 +0000 (17:22 +0100)]
hey pip!

2 years agonew example of dag with I/Os
SUTER Frederic [Tue, 21 Dec 2021 16:21:03 +0000 (17:21 +0100)]
new example of dag with I/Os

2 years ago(crudly) deal with I/O launched by maestro
SUTER Frederic [Tue, 21 Dec 2021 16:20:17 +0000 (17:20 +0100)]
(crudly) deal with I/O launched by maestro

2 years agoremove commented code
SUTER Frederic [Tue, 21 Dec 2021 15:35:23 +0000 (16:35 +0100)]
remove commented code

2 years agomove tests on dependencies to a better place
SUTER Frederic [Tue, 21 Dec 2021 10:38:41 +0000 (11:38 +0100)]
move tests on dependencies to a better place

2 years agoreplace old and counter-intuitive simdag-throttling example by modern comm-throttling
SUTER Frederic [Tue, 21 Dec 2021 10:00:44 +0000 (11:00 +0100)]
replace old and counter-intuitive simdag-throttling example by modern comm-throttling

2 years agouseless flag, already default value
SUTER Frederic [Tue, 21 Dec 2021 09:07:35 +0000 (10:07 +0100)]
useless flag, already default value

2 years agocosmetics and wrapper
SUTER Frederic [Tue, 21 Dec 2021 09:01:27 +0000 (10:01 +0100)]
cosmetics and wrapper

2 years agono dangling else
SUTER Frederic [Mon, 20 Dec 2021 20:55:33 +0000 (21:55 +0100)]
no dangling else

2 years agoreplace old simdag-fail example by new s4u-dag-failure one
SUTER Frederic [Mon, 20 Dec 2021 20:13:28 +0000 (21:13 +0100)]
replace old simdag-fail example by new s4u-dag-failure one

2 years agoextend failure to parallel activities owned by maestro
SUTER Frederic [Mon, 20 Dec 2021 20:09:43 +0000 (21:09 +0100)]
extend failure to parallel activities owned by maestro

2 years agoallowed to do that in this state too
SUTER Frederic [Mon, 20 Dec 2021 20:08:21 +0000 (21:08 +0100)]
allowed to do that in this state too

2 years agoallow an Exec to be unscheduled (reset host list, flops and bytes vector, and start...
SUTER Frederic [Mon, 20 Dec 2021 15:09:33 +0000 (16:09 +0100)]
allow an Exec to be unscheduled (reset host list, flops and bytes vector, and start time)

2 years agomake Exec started by maestro fail when a host is turned off
SUTER Frederic [Mon, 20 Dec 2021 14:20:39 +0000 (15:20 +0100)]
make Exec started by maestro fail when a host is turned off

2 years agoalso display start and finish time on Exec completion
SUTER Frederic [Thu, 16 Dec 2021 23:58:43 +0000 (00:58 +0100)]
also display start and finish time on Exec completion

2 years agoneed to set Exec finish time when created by maestro
SUTER Frederic [Thu, 16 Dec 2021 23:57:50 +0000 (00:57 +0100)]
need to set Exec finish time when created by maestro

2 years agodocs: fix some broken references in python
Martin Quinson [Wed, 15 Dec 2021 23:31:48 +0000 (00:31 +0100)]
docs: fix some broken references in python

2 years agoFix pip builds. Again
Martin Quinson [Wed, 15 Dec 2021 15:40:43 +0000 (16:40 +0100)]
Fix pip builds. Again

2 years agoFix clang builds
Martin Quinson [Wed, 15 Dec 2021 15:21:40 +0000 (16:21 +0100)]
Fix clang builds

2 years agoNew function: Engine::track_vetoed_activities()
Martin Quinson [Wed, 15 Dec 2021 14:51:29 +0000 (15:51 +0100)]
New function: Engine::track_vetoed_activities()

2 years agoNew signal: Activity::on_veto, to detect when an activity fails to start
Martin Quinson [Tue, 14 Dec 2021 20:10:18 +0000 (21:10 +0100)]
New signal: Activity::on_veto, to detect when an activity fails to start

2 years agoMissing documentation segment
Martin Quinson [Tue, 14 Dec 2021 16:40:05 +0000 (17:40 +0100)]
Missing documentation segment

2 years agoknow whether an activity has solved all its dependencies
SUTER Frederic [Tue, 14 Dec 2021 16:28:58 +0000 (17:28 +0100)]
know whether an activity has solved all its dependencies

2 years agoFix pip builds
Martin Quinson [Tue, 14 Dec 2021 16:29:11 +0000 (17:29 +0100)]
Fix pip builds

2 years agoEngine::run_until: documentation + C bindings
Martin Quinson [Tue, 14 Dec 2021 16:27:41 +0000 (17:27 +0100)]
Engine::run_until: documentation + C bindings

2 years agoAdd an example for Engine::run_until()
Martin Quinson [Tue, 14 Dec 2021 16:18:01 +0000 (17:18 +0100)]
Add an example for Engine::run_until()

2 years agoNew: Engine::run_until(date) to split the simulation
Martin Quinson [Tue, 14 Dec 2021 16:17:08 +0000 (17:17 +0100)]
New: Engine::run_until(date) to split the simulation

2 years agoFix ExecImpl::get_remaining to return the right value when not started
Martin Quinson [Tue, 14 Dec 2021 16:15:29 +0000 (17:15 +0100)]
Fix ExecImpl::get_remaining to return the right value when not started

2 years agosame thing here
Augustin Degomme [Mon, 13 Dec 2021 18:17:55 +0000 (19:17 +0100)]
same thing here

2 years agoPlease GCC-12 which warns us of a (potentially buggy) truncation.
Augustin Degomme [Mon, 13 Dec 2021 17:38:12 +0000 (18:38 +0100)]
Please GCC-12 which warns us of a (potentially buggy) truncation.
int can indeed go up to 12 chars in length, if 32 bits int is assumed.

2 years agoDocument my last hack
Martin Quinson [Mon, 13 Dec 2021 16:22:54 +0000 (17:22 +0100)]
Document my last hack

2 years agoAdd a function to retrieve the ns3 node from the s4u host
Martin Quinson [Mon, 13 Dec 2021 10:40:22 +0000 (11:40 +0100)]
Add a function to retrieve the ns3 node from the s4u host

2 years agoAnother reference in foreign language
Martin Quinson [Mon, 13 Dec 2021 10:33:17 +0000 (11:33 +0100)]
Another reference in foreign language

2 years agoSonar code smells
Bruno Donassolo [Tue, 7 Dec 2021 10:44:11 +0000 (11:44 +0100)]
Sonar code smells

2 years agoSMPI calibration: saving notebook execution
Bruno Donassolo [Mon, 6 Dec 2021 20:23:02 +0000 (20:23 +0000)]
SMPI calibration: saving notebook execution

2 years agoSMPI network calibration: tutorial
Bruno Donassolo [Wed, 10 Nov 2021 14:19:49 +0000 (15:19 +0100)]
SMPI network calibration: tutorial

Presents how to do a proper SMPI calibration using SimGrid.
Extract models for communications from real measures of dahu cluster.
The models are created automatically using pycewise and ckmeans/dhist.

Implemented support for dynamic cost in SMPI operations.

Main chainges:
* New tutorial: includes a dockerfile and jupyter notebook explaining
how to do the SMPI calibration
* SMPI dynamic costs: added API to allow user to add a callback to set
dynamic costs for MPI_Send, MPI_Isend and MPI_Recv operations.
  - ortogonal with other costs configs, e.g. smpi/os, smpi/or.
* New example: examples/smpi/comm_dynamic_costs

2 years agodoc: Fix indent for cosmetics [noci]
Martin Quinson [Thu, 2 Dec 2021 14:06:27 +0000 (15:06 +0100)]
doc: Fix indent for cosmetics [noci]

2 years agothread factory + dlopen privatization seems to be working now on osx systems (at...
Augustin Degomme [Fri, 19 Nov 2021 21:28:36 +0000 (21:28 +0000)]
thread factory + dlopen privatization seems to be working now on osx systems (at least on our ci system, let see others).

2 years agoThis should be fixed by now, remove the workaround ( https://github.com/ScoopInstalle...
Augustin Degomme [Fri, 19 Nov 2021 15:32:02 +0000 (15:32 +0000)]
This should be fixed by now, remove the workaround ( https://github.com/ScoopInstaller/Main/issues/1752 )

2 years agocontinue to mess up with simdag
SUTER Frederic [Sat, 13 Nov 2021 16:12:14 +0000 (17:12 +0100)]
continue to mess up with simdag

2 years agoplug leak
SUTER Frederic [Sat, 13 Nov 2021 09:44:13 +0000 (10:44 +0100)]
plug leak

2 years agofix jedule build
SUTER Frederic [Sat, 13 Nov 2021 09:38:42 +0000 (10:38 +0100)]
fix jedule build

2 years agofix 32 bits build (bis, damnit)
SUTER Frederic [Fri, 12 Nov 2021 21:42:03 +0000 (22:42 +0100)]
fix 32 bits build (bis, damnit)

2 years agofix 32 bits build
SUTER Frederic [Fri, 12 Nov 2021 21:34:16 +0000 (22:34 +0100)]
fix 32 bits build

2 years agoObjectify SD_task_t
SUTER Frederic [Fri, 12 Nov 2021 19:15:46 +0000 (20:15 +0100)]
Objectify SD_task_t

2 years agoRevert "use smart pointers for kernel timers"
SUTER Frederic [Wed, 10 Nov 2021 13:53:23 +0000 (14:53 +0100)]
Revert "use smart pointers for kernel timers"

This reverts commit 322e28c4503ed99d6c36ad9f450a3c0e515b4a8d.

2 years agorename synchro logging categories (simix->ker)
SUTER Frederic [Wed, 10 Nov 2021 10:50:41 +0000 (11:50 +0100)]
rename synchro logging categories (simix->ker)

2 years agouse smart pointers for kernel timers
SUTER Frederic [Wed, 10 Nov 2021 10:34:15 +0000 (11:34 +0100)]
use smart pointers for kernel timers

2 years agorefactor exception handling for activities
SUTER Frederic [Wed, 10 Nov 2021 09:53:23 +0000 (10:53 +0100)]
refactor exception handling for activities

2 years ago[sonar] constify
SUTER Frederic [Wed, 10 Nov 2021 08:40:11 +0000 (09:40 +0100)]
[sonar] constify

2 years agorename log category from simix_context to ker_context
SUTER Frederic [Tue, 9 Nov 2021 17:34:55 +0000 (18:34 +0100)]
rename log category from simix_context to ker_context

2 years agorename log category from simix_process to ker_actor
SUTER Frederic [Tue, 9 Nov 2021 17:25:52 +0000 (18:25 +0100)]
rename log category from simix_process to ker_actor

2 years agoremove timeout_cb only once + cosmetics
SUTER Frederic [Tue, 9 Nov 2021 16:58:15 +0000 (17:58 +0100)]
remove timeout_cb only once + cosmetics

2 years ago[sonar] Refactor to reduce cognitive complexity
SUTER Frederic [Tue, 9 Nov 2021 16:12:06 +0000 (17:12 +0100)]
[sonar] Refactor to reduce cognitive complexity

2 years agoone less include file
SUTER Frederic [Tue, 9 Nov 2021 11:06:04 +0000 (12:06 +0100)]
one less include file

2 years agoit may be a double, but not an int
SUTER Frederic [Tue, 9 Nov 2021 09:48:37 +0000 (10:48 +0100)]
it may be a double, but not an int

2 years agofix ns3 build (missing namespace)
SUTER Frederic [Tue, 9 Nov 2021 09:00:46 +0000 (10:00 +0100)]
fix ns3 build (missing namespace)

2 years agomove surf_presolve, surf_solve, and surf_get_clock to EngineImpl
SUTER Frederic [Tue, 9 Nov 2021 08:45:43 +0000 (09:45 +0100)]
move surf_presolve, surf_solve, and surf_get_clock to EngineImpl

2 years agosay bye to simgrid::surf namespace
SUTER Frederic [Mon, 8 Nov 2021 08:47:34 +0000 (09:47 +0100)]
say bye to simgrid::surf namespace

2 years agocosmetics
SUTER Frederic [Mon, 8 Nov 2021 08:00:26 +0000 (09:00 +0100)]
cosmetics

2 years agocosmetics
SUTER Frederic [Fri, 5 Nov 2021 10:09:28 +0000 (11:09 +0100)]
cosmetics

2 years agomove Cpu resource definition where it belongs
SUTER Frederic [Fri, 5 Nov 2021 09:49:56 +0000 (10:49 +0100)]
move Cpu resource definition where it belongs

2 years agocosmetics
SUTER Frederic [Fri, 5 Nov 2021 09:27:25 +0000 (10:27 +0100)]
cosmetics

2 years agoinclude cleanups after deprecation
SUTER Frederic [Fri, 5 Nov 2021 08:57:07 +0000 (09:57 +0100)]
include cleanups after deprecation

2 years agono reason to die here
SUTER Frederic [Fri, 5 Nov 2021 08:50:17 +0000 (09:50 +0100)]
no reason to die here

2 years ago[appveyor] Lazy fix for failing python tests.
Arnaud Giersch [Thu, 4 Nov 2021 17:10:15 +0000 (18:10 +0100)]
[appveyor] Lazy fix for failing python tests.

2 years agoReorganize VM code
SUTER Frederic [Thu, 4 Nov 2021 10:52:54 +0000 (11:52 +0100)]
Reorganize VM code

After 8 years of probation, let's consider VM as an actual part of S4U
rather than as a plugin. This change should be transparent for the
users.

+ Only the Live Migration and its dirty page tracking mechanisms remain
plugins.
+ The user interface has been moved to src/s4u and the kernel
counterpart to src/kernel/resource.
+ The simgrid::vm namespace doesn't exist anymore, but the live
migration stuff is in simgrid::plugin::vm
+ The contents of VmHostExt.* has been merged to
s4u_VirtualMachine.cpp and VirtualMachine.hpp as this extension is
always needed.
+ Cleanup a bit the namespaces too

2 years agoadd capacity to update priority of Execs too
SUTER Frederic [Sat, 30 Oct 2021 15:59:12 +0000 (17:59 +0200)]
add capacity to update priority of Execs too

2 years agoadd user friendly wrapper to set priorities on I/Os
SUTER Frederic [Sat, 30 Oct 2021 10:48:54 +0000 (12:48 +0200)]
add user friendly wrapper to set priorities on I/Os

2 years agoadd the capacity the update the priority of an I/O during its execution
SUTER Frederic [Fri, 29 Oct 2021 14:58:54 +0000 (16:58 +0200)]
add the capacity the update the priority of an I/O during its execution

2 years ago[no-ci] another copy/paste glitch
SUTER Frederic [Thu, 28 Oct 2021 07:49:56 +0000 (09:49 +0200)]
[no-ci] another copy/paste glitch

2 years agoSlightly improve coverage for xbt/config.
Arnaud Giersch [Fri, 29 Oct 2021 08:16:35 +0000 (10:16 +0200)]
Slightly improve coverage for xbt/config.

* add config::alias in unit tests
* add unit test triggering lookup of snake_case variant
* kill Config::dump (not publicly declared; redundant with Config::help)

2 years agoBe more user-friendly, and give a hint for options wrongly spelled in snake_case.
Arnaud Giersch [Thu, 28 Oct 2021 19:36:45 +0000 (21:36 +0200)]
Be more user-friendly, and give a hint for options wrongly spelled in snake_case.

2 years ago[no-ci] typos in comments
SUTER Frederic [Thu, 28 Oct 2021 07:32:05 +0000 (09:32 +0200)]
[no-ci] typos in comments

2 years agoadd capacity to set priorities on I/Os + example
SUTER Frederic [Thu, 28 Oct 2021 07:20:34 +0000 (09:20 +0200)]
add capacity to set priorities on I/Os + example

2 years agoDisplay test output to ease debugging.
Arnaud Giersch [Wed, 27 Oct 2021 14:20:04 +0000 (16:20 +0200)]
Display test output to ease debugging.

[ci-skip]

2 years ago[mc_dwarf] Continue with a warning on error.
Arnaud Giersch [Wed, 27 Oct 2021 13:14:34 +0000 (15:14 +0200)]
[mc_dwarf] Continue with a warning on error.

2 years ago[no-ci] update VM doc
SUTER Frederic [Wed, 27 Oct 2021 12:09:43 +0000 (14:09 +0200)]
[no-ci] update VM doc

2 years agoChange the way VMs are created.
SUTER Frederic [Wed, 27 Oct 2021 10:59:02 +0000 (12:59 +0200)]
Change the way VMs are created.

Instead of explicitly calling the ctor with new, use the physical host
as a factory thanks to the new Host::create_vm() method.

2 years agoreindent file
SUTER Frederic [Wed, 27 Oct 2021 09:24:59 +0000 (11:24 +0200)]
reindent file

2 years agoadd File::open and File::close in FileSystem plugin
SUTER Frederic [Wed, 27 Oct 2021 08:56:37 +0000 (10:56 +0200)]
add File::open and File::close in FileSystem plugin

+ better match between C and C++ APIs
+ save some explicit new/delete in user code

2 years ago[sonar] use shared_ptr instead of new/delete
SUTER Frederic [Wed, 27 Oct 2021 07:52:34 +0000 (09:52 +0200)]
[sonar] use shared_ptr instead of new/delete

2 years ago[sonar] add a few const
SUTER Frederic [Wed, 27 Oct 2021 07:33:59 +0000 (09:33 +0200)]
[sonar] add a few const

2 years agoMove kernel/resource/Resource.hpp in private section.
Arnaud Giersch [Tue, 26 Oct 2021 20:18:54 +0000 (22:18 +0200)]
Move kernel/resource/Resource.hpp in private section.

Rationale: includes several private files from src/kernel/.

2 years agoMove smpi_replay.hpp in private section.
Arnaud Giersch [Tue, 26 Oct 2021 20:07:16 +0000 (22:07 +0200)]
Move smpi_replay.hpp in private section.

Rationale: includes private smpi_actor.hpp.