Logo AND Algorithmique Numérique Distribuée

Public GIT Repository
simgrid.git
2 years agodocker: simgrid:stable should be built on top of debian:11
Martin Quinson [Sun, 12 Sep 2021 14:29:10 +0000 (16:29 +0200)]
docker: simgrid:stable should be built on top of debian:11

Not doing so leads to difficulties when debian:testing points to
another version.

2 years agodo not use unsigned there, -1 is used to indicate there is no route between hosts
SUTER Frederic [Mon, 6 Sep 2021 11:55:51 +0000 (13:55 +0200)]
do not use unsigned there, -1 is used to indicate there is no route between hosts

2 years agounsigned long-ing
SUTER Frederic [Mon, 6 Sep 2021 06:48:20 +0000 (08:48 +0200)]
unsigned long-ing

2 years ago[appveyor] Bump boost library version.
Arnaud Giersch [Sun, 5 Sep 2021 19:07:32 +0000 (21:07 +0200)]
[appveyor] Bump boost library version.

2 years agoKill redundant blank lines.
Arnaud Giersch [Fri, 3 Sep 2021 12:00:20 +0000 (14:00 +0200)]
Kill redundant blank lines.

2 years agofix 32-bit builds
SUTER Frederic [Sun, 5 Sep 2021 14:44:26 +0000 (16:44 +0200)]
fix 32-bit builds

2 years agoyet another bunch of int -> unsigned long
SUTER Frederic [Sun, 5 Sep 2021 11:53:56 +0000 (13:53 +0200)]
yet another bunch of int -> unsigned long

2 years agoanother bunch of new implicit conversions
SUTER Frederic [Sat, 4 Sep 2021 10:20:23 +0000 (12:20 +0200)]
another bunch of new implicit conversions

2 years agochain reaction when solving implicit cast smells
SUTER Frederic [Fri, 3 Sep 2021 08:48:17 +0000 (10:48 +0200)]
chain reaction when solving implicit cast smells

2 years agoforgot one access to now private field
SUTER Frederic [Fri, 3 Sep 2021 05:53:52 +0000 (07:53 +0200)]
forgot one access to now private field

2 years ago[procrasticommit] less implicit casts and more consistency
SUTER Frederic [Thu, 2 Sep 2021 14:52:45 +0000 (16:52 +0200)]
[procrasticommit] less implicit casts and more consistency

2 years ago[procasticommit] Do not mix private and public fields
SUTER Frederic [Thu, 2 Sep 2021 10:21:16 +0000 (12:21 +0200)]
[procasticommit] Do not mix private and public fields

2 years ago[sonar] forgot that one
SUTER Frederic [Thu, 2 Sep 2021 08:09:30 +0000 (10:09 +0200)]
[sonar] forgot that one

2 years agoplease sonar
SUTER Frederic [Tue, 31 Aug 2021 07:55:56 +0000 (09:55 +0200)]
please sonar

2 years agoUpdate success message
Augustin Degomme [Mon, 30 Aug 2021 17:44:42 +0000 (17:44 +0000)]
Update success message

2 years agoAdd mattermost notification to docker action
Augustin Degomme [Mon, 30 Aug 2021 16:09:28 +0000 (16:09 +0000)]
Add mattermost notification to docker action

2 years agoMerge branch 'lost+found_github-master'
Arnaud Giersch [Mon, 30 Aug 2021 12:48:32 +0000 (14:48 +0200)]
Merge branch 'lost+found_github-master'

2 years agoMerge branch 'segvhandler_fix' into 'master'
Arnaud Giersch [Mon, 30 Aug 2021 12:37:41 +0000 (12:37 +0000)]
Merge branch 'segvhandler_fix' into 'master'

Fix incorrect suggestion in segvhandler

See merge request simgrid/simgrid!69

2 years agoFix incorrect suggestion in segvhandler
Julien EMMANUEL [Mon, 30 Aug 2021 10:31:07 +0000 (12:31 +0200)]
Fix incorrect suggestion in segvhandler

In case of access violation the error message suggested to set an
ill-formed parameter value

2 years agoAdd docker images to ci (#378)
adegomme [Mon, 30 Aug 2021 12:18:35 +0000 (14:18 +0200)]
Add docker images to ci (#378)

* Create docker.yml

test without push

* add make stable

* framagit download path is easier now

* Update Makefile

* Update Makefile

* Update Makefile

* Update Makefile

* Update Makefile

* Update Makefile

* Update Makefile

* Update docker.yml

* Update docker.yml

* Update Makefile

* Update docker.yml

* trailing spaces

2 years agoone sentence inversion less [no-ci]
Martin Quinson [Fri, 27 Aug 2021 17:04:34 +0000 (19:04 +0200)]
one sentence inversion less [no-ci]

2 years agotypo
Augustin Degomme [Wed, 25 Aug 2021 09:23:11 +0000 (11:23 +0200)]
typo

2 years agofactorize findns3.cmake
Augustin Degomme [Wed, 25 Aug 2021 09:14:46 +0000 (11:14 +0200)]
factorize findns3.cmake
Still keeps a list of know/supported versions hardcoded. Inspired from FindBoost.cmake.

2 years agons-3: Make wifi creation compatible with ns-3 version 3.34 too
Martin Quinson [Tue, 24 Aug 2021 21:31:51 +0000 (23:31 +0200)]
ns-3: Make wifi creation compatible with ns-3 version 3.34 too

2 years agoMerge branch 'master' of framagit.org:simgrid/simgrid
Martin Quinson [Tue, 24 Aug 2021 21:27:31 +0000 (23:27 +0200)]
Merge branch 'master' of framagit.org:simgrid/simgrid

2 years agoIf I'm not mistaken, this is no longer necessary either.
Arnaud Giersch [Thu, 19 Aug 2021 06:03:27 +0000 (08:03 +0200)]
If I'm not mistaken, this is no longer necessary either.

2 years agoplease clang static analyser
SUTER Frederic [Tue, 24 Aug 2021 10:47:20 +0000 (12:47 +0200)]
please clang static analyser

2 years agoadd a FAILED state to activities. tested on comm and exec
SUTER Frederic [Mon, 23 Aug 2021 22:43:30 +0000 (00:43 +0200)]
add a FAILED state to activities. tested on comm and exec

2 years ago the issuer of a remote exec that fails should not die
SUTER Frederic [Mon, 23 Aug 2021 22:01:21 +0000 (00:01 +0200)]
 the issuer of a remote exec that fails should not die

2 years agonew attempt.. this bit of code was not useful, it looks like.
Augustin Degomme [Mon, 23 Aug 2021 20:45:56 +0000 (22:45 +0200)]
new attempt.. this bit of code was not useful, it looks like.

2 years agoRevert "Fix for clang 14: new check was added against substracting from a potential...
Augustin Degomme [Mon, 23 Aug 2021 20:42:46 +0000 (22:42 +0200)]
Revert "Fix for clang 14: new check was added against substracting from a potential nullptr."

This reverts commit 1c67b1098855cd6e7782c8379cfe27fc310144eb.

2 years agoFix for clang 14: new check was added against substracting from a potential nullptr.
Augustin Degomme [Mon, 23 Aug 2021 18:53:54 +0000 (20:53 +0200)]
Fix for clang 14: new check was added against substracting from a potential nullptr.

2 years agoplease clang14
Augustin Degomme [Mon, 23 Aug 2021 16:53:55 +0000 (18:53 +0200)]
please clang14

2 years agoRemote Exec should not survive to a host failure
SUTER Frederic [Mon, 23 Aug 2021 15:41:21 +0000 (17:41 +0200)]
Remote Exec should not survive to a host failure

2 years ago[ci-skip] oops++
Arnaud Giersch [Thu, 19 Aug 2021 05:43:45 +0000 (07:43 +0200)]
[ci-skip] oops++

2 years agoInitialize pointers with a known invalid (out-of-bound) value.
Arnaud Giersch [Tue, 17 Aug 2021 20:29:40 +0000 (22:29 +0200)]
Initialize pointers with a known invalid (out-of-bound) value.

2 years agoFactorize code, reindent, etc.
Arnaud Giersch [Wed, 18 Aug 2021 19:49:57 +0000 (21:49 +0200)]
Factorize code, reindent, etc.

2 years agoPrefer to use Mailbox::get_unique.
Arnaud Giersch [Wed, 18 Aug 2021 19:36:50 +0000 (21:36 +0200)]
Prefer to use Mailbox::get_unique.

2 years agoCosmetics for sonar&co.
Arnaud Giersch [Wed, 18 Aug 2021 15:57:22 +0000 (17:57 +0200)]
Cosmetics for sonar&co.

2 years agoImproving doc and changelog
Bruno Donassolo [Wed, 18 Aug 2021 14:50:52 +0000 (16:50 +0200)]
Improving doc and changelog

2 years agoPleases somewhat codefactor.io, lgtm, and pvs-studio.
Arnaud Giersch [Tue, 17 Aug 2021 19:01:54 +0000 (21:01 +0200)]
Pleases somewhat codefactor.io, lgtm, and pvs-studio.

2 years agoFix fedora:rawhide, actor name forgotten
Bruno Donassolo [Tue, 17 Aug 2021 14:29:20 +0000 (16:29 +0200)]
Fix fedora:rawhide, actor name forgotten

2 years agoPlease sonar a little
Bruno Donassolo [Tue, 17 Aug 2021 10:30:23 +0000 (12:30 +0200)]
Please sonar a little

2 years agoPython: example CPU nonlinear
Bruno Donassolo [Mon, 16 Aug 2021 15:27:29 +0000 (17:27 +0200)]
Python: example CPU nonlinear

2 years agoPython: an example with disks
Bruno Donassolo [Mon, 16 Aug 2021 14:09:58 +0000 (16:09 +0200)]
Python: an example with disks

2 years agomodernize SIMIX_comm_set_copy_data_callback
SUTER Frederic [Mon, 16 Aug 2021 18:09:42 +0000 (20:09 +0200)]
modernize SIMIX_comm_set_copy_data_callback

2 years agoCMake: get ready for some future versions of ns-3
Martin Quinson [Mon, 16 Aug 2021 17:29:59 +0000 (19:29 +0200)]
CMake: get ready for some future versions of ns-3

2 years agoTry to make linking succeed with mingw64 (appveyor).
Arnaud Giersch [Mon, 16 Aug 2021 12:38:29 +0000 (14:38 +0200)]
Try to make linking succeed with mingw64 (appveyor).

2 years agoAdd some words about known problem with ns3 on Debian 11/Bullseye.
Arnaud Giersch [Mon, 16 Aug 2021 12:29:42 +0000 (14:29 +0200)]
Add some words about known problem with ns3 on Debian 11/Bullseye.

2 years agoFix memleak in teshsuite test
Bruno Donassolo [Mon, 16 Aug 2021 09:54:45 +0000 (11:54 +0200)]
Fix memleak in teshsuite test

2 years agoPotpourri of python bindings (disk, host, netzone)
Bruno Donassolo [Fri, 13 Aug 2021 17:05:21 +0000 (19:05 +0200)]
Potpourri of python bindings (disk, host, netzone)

Add several methods to python bindings.
Add a test mixing them.

2 years agoPython: complex cluster example
Bruno Donassolo [Wed, 11 Aug 2021 17:37:40 +0000 (19:37 +0200)]
Python: complex cluster example

Adds examples of fat-tree, dragonfly and torus cluster using python
bindinds.

New python bindings have been added.

2 years agoPython network-nonlinear example
Bruno Donassolo [Wed, 11 Aug 2021 17:37:22 +0000 (19:37 +0200)]
Python network-nonlinear example

Implement network-nonlinear using python bindings.

Add bindings support for many methods (Link, NetZone, etc), hovewer not fully covered.

2 years agohttps://framagit.org/simgrid/simgrid/-/issues/77 is fixed
Martin Quinson [Thu, 12 Aug 2021 15:56:34 +0000 (17:56 +0200)]
https://framagit.org/simgrid/simgrid/-/issues/77 is fixed

2 years agoUpdate RTD sphinx theme version to v0.5.2
Martin Quinson [Thu, 12 Aug 2021 15:28:05 +0000 (17:28 +0200)]
Update RTD sphinx theme version to v0.5.2

This is an attempt at https://framagit.org/simgrid/simgrid/-/issues/77

2 years agochangelog update
Augustin Degomme [Thu, 12 Aug 2021 14:18:54 +0000 (16:18 +0200)]
changelog update

2 years agoSMPI - Allow the use of ISP tests without MC activated (for the ones without errors)
Augustin Degomme [Thu, 12 Aug 2021 14:18:47 +0000 (16:18 +0200)]
SMPI - Allow the use of ISP tests without MC activated (for the ones without errors)

2 years ago[ci-skip] sonar - oops
Augustin Degomme [Tue, 10 Aug 2021 15:06:12 +0000 (17:06 +0200)]
[ci-skip] sonar - oops

2 years agofix potential leak in replay, as a temporary buffer may be created and never freed.
Augustin Degomme [Tue, 10 Aug 2021 10:46:27 +0000 (12:46 +0200)]
fix potential leak in replay, as a temporary buffer may be created and never freed.
This was seen with a reduce scatter collective from mpich, which creates derived datatypes internally.

2 years agosomehow the wrong tag was used for these colls.
Augustin Degomme [Tue, 10 Aug 2021 10:45:47 +0000 (12:45 +0200)]
somehow the wrong tag was used for these colls.

2 years agoexclude this file from scan-build and sonar analysis, as the uninitialized value...
Augustin Degomme [Tue, 10 Aug 2021 10:45:28 +0000 (12:45 +0200)]
exclude this file from scan-build and sonar analysis, as the uninitialized value is intentional

2 years agoFix factor callback type
Bruno Donassolo [Tue, 10 Aug 2021 09:07:10 +0000 (11:07 +0200)]
Fix factor callback type

2 years agoCPU factors: dynamic factors for CPU
Bruno Donassolo [Mon, 9 Aug 2021 13:46:24 +0000 (15:46 +0200)]
CPU factors: dynamic factors for CPU

- Allows the use of user's callback to change the speed at the
update_remaining.
- Add a simple example.
- Minor improv. for disk
- Update changelog
- Available only for Cas01 (not ptask or TI)

2 years agoAdd test for multicore speed/state file
Bruno Donassolo [Fri, 6 Aug 2021 18:36:27 +0000 (20:36 +0200)]
Add test for multicore speed/state file

2 years agoReworking user_bound for Exec actions.
Bruno Donassolo [Fri, 6 Aug 2021 13:44:58 +0000 (15:44 +0200)]
Reworking user_bound for Exec actions.

Avoid using directly surf_action->set_bound to modify action's bound.

Actual bound is defined by CPU model, for cas01 is the min of:
- user's bound
- requested_core*speed*scale.

Explicitly deny the use of user_bound_ for ptask and cpuTI. We need
proper tests to verify their behavior.

2 years agoRemove old fixme
Bruno Donassolo [Thu, 5 Aug 2021 13:43:30 +0000 (15:43 +0200)]
Remove old fixme

These fixmes was necessary to implement multi-models.
By now, we stick with only 1 model.

2 years agoAdd interface to create Profile
Bruno Donassolo [Thu, 5 Aug 2021 13:40:16 +0000 (15:40 +0200)]
Add interface to create Profile

Allows the use of speed/state profiles by C++ interface.

2 years agoSo Intel compiler is now detected as IntelLLVM and no longer as Clang12.
Augustin Degomme [Sat, 7 Aug 2021 23:56:20 +0000 (01:56 +0200)]
So Intel compiler is now detected as IntelLLVM and no longer as Clang12.

2 years agoThis test actually needs uninitialized values for some ranks, silence clang warning
Augustin Degomme [Sat, 7 Aug 2021 23:08:25 +0000 (01:08 +0200)]
This test actually needs uninitialized values for some ranks, silence clang warning

2 years agorename test, to avoid multiple files with same name
Augustin Degomme [Sat, 7 Aug 2021 23:07:56 +0000 (01:07 +0200)]
rename test, to avoid multiple files with same name

2 years agoAdd a new ti-tracing/replay test (in teshsuite) to improve coverage.
Augustin Degomme [Sat, 7 Aug 2021 22:29:14 +0000 (00:29 +0200)]
Add a new ti-tracing/replay test (in teshsuite) to improve coverage.
It tests all collectives, generates a trace, then replays it while tracing again, and checks that both traces are identical.

2 years agotry to have reduce_scatter output identically on re-tracing
Augustin Degomme [Sat, 7 Aug 2021 21:56:19 +0000 (23:56 +0200)]
try to have reduce_scatter output identically on re-tracing
ugly.

2 years agoallow smpi/init option in replay as well.
Augustin Degomme [Sat, 7 Aug 2021 21:38:35 +0000 (23:38 +0200)]
allow smpi/init option in replay as well.

2 years agooops, maxsize was needed here.
Augustin Degomme [Sat, 7 Aug 2021 19:49:05 +0000 (21:49 +0200)]
oops, maxsize was needed here.

2 years agoreplay : add actions scan and exscan
Augustin Degomme [Sat, 7 Aug 2021 18:38:13 +0000 (20:38 +0200)]
replay : add actions scan and exscan

2 years agomultiple fixes for replay
Augustin Degomme [Sat, 7 Aug 2021 17:28:23 +0000 (19:28 +0200)]
multiple fixes for replay
in case of MPI_IN_PLACE or non relevant parameters, we could output nonsense to the ti trace

2 years agofix issues in replay of scatter and scatterv
Augustin Degomme [Sat, 7 Aug 2021 17:25:23 +0000 (19:25 +0200)]
fix issues in replay of scatter and scatterv

2 years agosecure collectives against some allowed uninitialized variables
Augustin Degomme [Sat, 7 Aug 2021 12:55:11 +0000 (14:55 +0200)]
secure collectives against some allowed uninitialized variables

2 years agoensure alltoallv tracing/replay/tracing again is coherent.
Augustin Degomme [Sat, 7 Aug 2021 12:00:31 +0000 (14:00 +0200)]
ensure alltoallv tracing/replay/tracing again is coherent.

2 years agoprevious ti-tracing improvement for bcast and reduce was not a good idea.
Augustin Degomme [Fri, 6 Aug 2021 21:30:58 +0000 (23:30 +0200)]
previous ti-tracing improvement for bcast and reduce was not a good idea.
these are already ranks.

2 years agoswitch from pid to rank for ti-tracing the wait action
Augustin Degomme [Fri, 6 Aug 2021 16:47:12 +0000 (18:47 +0200)]
switch from pid to rank for ti-tracing the wait action
It was not working well before and was leading to discrepancies and impossible to replay traces.

2 years agoOther fix for #78 : Fortran logical and MPI_LOGICAL are actually 32 bits wide, not...
Augustin Degomme [Fri, 6 Aug 2021 13:00:40 +0000 (15:00 +0200)]
Other fix for #78 : Fortran logical and MPI_LOGICAL are actually 32 bits wide, not 8, and should not be mapped to MPI_C_BOOL but to MPI_INTEGER32 internally.
Because why not.

2 years agorequalify tesh.
Augustin Degomme [Thu, 5 Aug 2021 23:19:59 +0000 (01:19 +0200)]
requalify tesh.
We removed a sleep(0), so another process finishes.

2 years agoreplay: small changes to avoid discrepencies when tracing the replay itself
Augustin Degomme [Thu, 5 Aug 2021 23:12:27 +0000 (01:12 +0200)]
replay: small changes to avoid discrepencies when tracing the replay itself

2 years agoallow the use of cfg=smpi/finalization-barrier for replay as well.
Augustin Degomme [Thu, 5 Aug 2021 15:23:16 +0000 (17:23 +0200)]
allow the use of cfg=smpi/finalization-barrier for replay as well.
In some cases, some processes might try to leave a bit too early, this has to be investigated.

2 years agoimprove iterations to fill vectors
Augustin Degomme [Thu, 5 Aug 2021 15:04:53 +0000 (17:04 +0200)]
improve iterations to fill vectors
(probably not very useful)

2 years agokill is_replayable() for datatypes.
Augustin Degomme [Thu, 5 Aug 2021 14:48:02 +0000 (16:48 +0200)]
kill is_replayable() for datatypes.
It was useless since we've been encoding/decoding all datatypes for a long time now.
This could break ancient TI traces handling, but I'm really not sure of this actually, and it was causing issues.
We need more testing on TI traces and replay :\

2 years agoFix for fg #78 : allotallv/w tracing was reporting wrong size in some cases for repla...
Augustin Degomme [Thu, 5 Aug 2021 11:09:33 +0000 (13:09 +0200)]
Fix for fg #78 : allotallv/w tracing was reporting wrong size in some cases for replayable traces.

2 years agoLatest stable (2.7.1) of pybind11 fixed issue with mingw64.
Arnaud Giersch [Wed, 4 Aug 2021 08:51:37 +0000 (10:51 +0200)]
Latest stable (2.7.1) of pybind11 fixed issue with mingw64.

Ref. https://framagit.org/simgrid/simgrid/-/issues/76

2 years agoSonar and minor improv in doc
Bruno Donassolo [Mon, 2 Aug 2021 08:32:42 +0000 (10:32 +0200)]
Sonar and minor improv in doc

2 years agoUpdate README.md
Arnaud Legrand [Sat, 31 Jul 2021 06:09:39 +0000 (06:09 +0000)]
Update README.md

2 years agoModeling hints: I/O operations
Bruno Donassolo [Fri, 16 Jul 2021 15:54:53 +0000 (17:54 +0200)]
Modeling hints: I/O operations

Adds an example showing how to model I/O operation in SimGrid.
It uses data from real experiments on Grid'5000 to model the impact of
concurrent operation on disks and the variability/noise in single I/O
operations.

Adds an entry in the doc presenting the results.
The code is available at: docs/source/tuto_disk.

The rst file was generated from the analysis.org file.
The folder includes a dockerfile to rerun the experiment if needed.

2 years agoFix NetworkCm02Link::set_bandwidth.
Bruno Donassolo [Wed, 28 Jul 2021 13:49:06 +0000 (15:49 +0200)]
Fix NetworkCm02Link::set_bandwidth.

Fix penalty update when some communication is happening in the link.
Add test for set_bandwidth and set_latency.

2 years agoOops, forgotten files
Bruno Donassolo [Tue, 27 Jul 2021 19:09:30 +0000 (21:09 +0200)]
Oops, forgotten files

2 years agoFix set_read_bandwidth and set_write_bandwidth for disks
Bruno Donassolo [Tue, 27 Jul 2021 18:53:35 +0000 (20:53 +0200)]
Fix set_read_bandwidth and set_write_bandwidth for disks

- Remove update_penalty method. Disk actions either are suspended or
running, this is managed by the Action class already.
- Only updating the constraint value seems enough for set_bandwidth
functions.
- Add a teshsuite for it

2 years agoCreate Disk::set_readwrite_bandwidth
Bruno Donassolo [Tue, 27 Jul 2021 12:27:10 +0000 (14:27 +0200)]
Create Disk::set_readwrite_bandwidth

Allow user to change readwrite constraint bound

2 years agoI/O factors: noise for disks.
Bruno Donassolo [Tue, 27 Jul 2021 08:23:30 +0000 (10:23 +0200)]
I/O factors: noise for disks.

Implements variability in disk operations.
Similarly to network factors, the effective amount of bytes read/written
in disk operations is scaled by a factor defined by the user.

Users can define a different callback for each disk. The callback is
called when SimGrid updates the remaining amount of bytes in disk
operations.

2 years agoUpdate README.md
Arnaud Legrand [Fri, 30 Jul 2021 12:43:19 +0000 (12:43 +0000)]
Update README.md

2 years agoMerge branch 'doc_link' into 'master'
Arnaud Giersch [Wed, 28 Jul 2021 12:48:24 +0000 (12:48 +0000)]
Merge branch 'doc_link' into 'master'

Fix broken link to releases in doc

See merge request simgrid/simgrid!68

2 years agoFix broken link to releases
Julien EMMANUEL [Wed, 28 Jul 2021 11:24:33 +0000 (13:24 +0200)]
Fix broken link to releases

Thanks Mael for reporting this one