Logo AND Algorithmique Numérique Distribuée

Public GIT Repository
simgrid.git
9 months agointroduces <disk> and s4u::Disk
Frederic Suter [Wed, 25 Sep 2019 18:14:55 +0000 (20:14 +0200)]
introduces <disk> and s4u::Disk

9 months agoMerge branch 'master' into disk
Frederic Suter [Wed, 25 Sep 2019 18:14:27 +0000 (20:14 +0200)]
Merge branch 'master' into disk

9 months agoMerge branch 'master' of https://framagit.org/simgrid/simgrid
Frederic Suter [Wed, 25 Sep 2019 18:14:13 +0000 (20:14 +0200)]
Merge branch 'master' of https://framagit.org/simgrid/simgrid

9 months agoregenerate smpi_extended_traces.h and friends after the addition of MPI_Bsend and...
Martin Quinson [Wed, 25 Sep 2019 16:11:23 +0000 (18:11 +0200)]
regenerate smpi_extended_traces.h and friends after the addition of MPI_Bsend and friends

9 months agoKill TRACE_smpi_finalize() and have the container unregistered as soon as the actor...
Martin Quinson [Wed, 25 Sep 2019 16:09:59 +0000 (18:09 +0200)]
Kill TRACE_smpi_finalize() and have the container unregistered as soon as the actor leaves

Of course this requires to revalidate some tesh files, as the ending
date is impacted by this change.

9 months agoMerge branch 'master' into disk
Frederic Suter [Wed, 25 Sep 2019 15:36:52 +0000 (17:36 +0200)]
Merge branch 'master' into disk

9 months agoMerge branch 'master' of https://framagit.org/simgrid/simgrid
Frederic Suter [Wed, 25 Sep 2019 15:36:39 +0000 (17:36 +0200)]
Merge branch 'master' of https://framagit.org/simgrid/simgrid

9 months agoremove trace finalize from process ending, cleanup is done by trace_end anyway.
Augustin Degomme [Wed, 25 Sep 2019 13:31:39 +0000 (15:31 +0200)]
remove trace finalize from process ending, cleanup is done by trace_end anyway.

9 months agofix a memleak coming from cyclic references in smart pointers
Martin Quinson [Wed, 25 Sep 2019 11:00:50 +0000 (13:00 +0200)]
fix a memleak coming from cyclic references in smart pointers

Before that change, the SMPI extension of actors got a smart reference
onto the S4U actor. That prevented S4U actors from being garbage
collected, since a SMPI extension is freed (and its smart references
released) only when the S4U actor is destroyed.

The change of this commit simply replace smart references with dumb
pointers to break the deadlock in the reference cycle, so that s4u
actors get collected after use.

9 months agodocument last change
Martin Quinson [Mon, 23 Sep 2019 19:30:57 +0000 (21:30 +0200)]
document last change

9 months agoMerge branch 'master' into disk
Frederic Suter [Tue, 24 Sep 2019 15:57:26 +0000 (17:57 +0200)]
Merge branch 'master' into disk

9 months agoMerge branch 'master' of https://framagit.org/simgrid/simgrid
Frederic Suter [Tue, 24 Sep 2019 15:56:56 +0000 (17:56 +0200)]
Merge branch 'master' of https://framagit.org/simgrid/simgrid

9 months agowarning --
Augustin Degomme [Tue, 24 Sep 2019 15:41:53 +0000 (17:41 +0200)]
warning --

9 months agomove newly implemented calls out of the 'not yet implemented' section
Augustin Degomme [Tue, 24 Sep 2019 14:27:09 +0000 (16:27 +0200)]
move newly implemented calls out of the 'not yet implemented' section

9 months agochangelog update
Augustin Degomme [Tue, 24 Sep 2019 14:26:45 +0000 (16:26 +0200)]
changelog update

9 months agoactivate bsend tests.
Augustin Degomme [Tue, 24 Sep 2019 14:18:25 +0000 (16:18 +0200)]
activate bsend tests.
Modify one to stop spending too much time sleeping as we test with bogus platforms.

9 months agoadd MPI_Bsend, MPI_Ibsend, MPI_Bsend_init, MPI_Buffer_attach, MPI_Buffer_detach.
Augustin Degomme [Tue, 24 Sep 2019 14:16:13 +0000 (16:16 +0200)]
add MPI_Bsend, MPI_Ibsend, MPI_Bsend_init, MPI_Buffer_attach, MPI_Buffer_detach.
fun fact: we are not actually using the provided buffer in SMPI, as we use our own buffers internally for all detached calls (bsend means detached).

9 months agoMerge branch 'master' into 'master'
Martin Quinson [Mon, 23 Sep 2019 19:29:04 +0000 (21:29 +0200)]
Merge branch 'master' into 'master'

Improving the performance of the NS-3 bindings by:

See merge request simgrid/simgrid!18

9 months agoImproving the performance of the NS-3 bindings by:
bcamus [Mon, 23 Sep 2019 16:38:27 +0000 (18:38 +0200)]
Improving the performance of the NS-3 bindings by:
  + Stop moving NS-3 forward when there is no flow, and synchronizing NS-3 with SimGrid only when a new flow starts instead.
  + Cancelling the Stop event we scheduled in NS-3 if the simulator stops before the event, to prevent untimely stops.

9 months agoStart preparing for a release
Martin Quinson [Mon, 23 Sep 2019 09:48:42 +0000 (11:48 +0200)]
Start preparing for a release

9 months agoDon't mandate C++14 as some build daemons still don't have it
Martin Quinson [Mon, 23 Sep 2019 09:36:28 +0000 (11:36 +0200)]
Don't mandate C++14 as some build daemons still don't have it

9 months agofix make dist (again and again)
Martin Quinson [Mon, 23 Sep 2019 09:04:31 +0000 (11:04 +0200)]
fix make dist (again and again)

9 months agoMC: switch to xxhash as a (fast) hashing function.
Martin Quinson [Mon, 23 Sep 2019 08:49:42 +0000 (10:49 +0200)]
MC: switch to xxhash as a (fast) hashing function.

Mandates C++14 but should be faster according to
https://aras-p.info/blog/2016/08/02/Hash-Functions-all-the-way-down/

9 months agoAdd a fast hash function (mandates C++14 for MC)
Martin Quinson [Mon, 23 Sep 2019 07:55:56 +0000 (09:55 +0200)]
Add a fast hash function (mandates C++14 for MC)

This comes from
https://github.com/RedSpah/xxhash_cpp/commit/a310676e1514b49d78f0c9ced0678efea4f82fd9

This requires C++14:
  xxhash.hpp:288:40: error: variable declaration in a constexpr function is a C++14 extension

So bump the dependencies of the Model Checker to C++14. That's an
intrusive move, but MC is experimental anyway, and C++14 isn't that
modern anymore.

9 months agofix make dist
Martin Quinson [Mon, 23 Sep 2019 00:36:33 +0000 (02:36 +0200)]
fix make dist

9 months agoMake this test more verbose to improve debuggability
Martin Quinson [Mon, 23 Sep 2019 00:34:34 +0000 (02:34 +0200)]
Make this test more verbose to improve debuggability

9 months agoMerge the two wifi tests together
Martin Quinson [Mon, 23 Sep 2019 00:06:47 +0000 (02:06 +0200)]
Merge the two wifi tests together

9 months agoMerge the two wifi platform files
Martin Quinson [Sun, 22 Sep 2019 23:19:48 +0000 (01:19 +0200)]
Merge the two wifi platform files

And rename the result to simply 'wifi.xml'

9 months agomodernize these platform files
Martin Quinson [Sun, 22 Sep 2019 23:09:02 +0000 (01:09 +0200)]
modernize these platform files

9 months agointegrate the wifi unit tests
Martin Quinson [Sun, 22 Sep 2019 22:55:54 +0000 (00:55 +0200)]
integrate the wifi unit tests

9 months agoreduce the verbosity of this test and increase its effectiveness
Martin Quinson [Sun, 22 Sep 2019 22:31:59 +0000 (00:31 +0200)]
reduce the verbosity of this test and increase its effectiveness

This is merely a crash test

9 months agoRemove the Codacy badge since we unplugged that project
Martin Quinson [Fri, 20 Sep 2019 19:37:58 +0000 (21:37 +0200)]
Remove the Codacy badge since we unplugged that project

9 months agoadd missing platform file in the dist
Augustin Degomme [Fri, 20 Sep 2019 14:37:53 +0000 (16:37 +0200)]
add missing platform file in the dist

9 months agoDocument recent changes
Martin Quinson [Fri, 20 Sep 2019 13:38:37 +0000 (15:38 +0200)]
Document recent changes

9 months agoadd NS3 files to the dist even when NS3 is not configured
Augustin Degomme [Fri, 20 Sep 2019 13:28:31 +0000 (15:28 +0200)]
add NS3 files to the dist even when NS3 is not configured

9 months agoMerge branch 'master' into 'master'
Martin Quinson [Fri, 20 Sep 2019 12:57:08 +0000 (14:57 +0200)]
Merge branch 'master' into 'master'

NS-3: unblock the number of communications + detect when several flows are simultaneously finishing

See merge request simgrid/simgrid!17

9 months agomention closing of GH#207
Frederic Suter [Fri, 20 Sep 2019 10:27:58 +0000 (12:27 +0200)]
mention closing of GH#207

9 months agoMerge branch 'master' into disk
Frederic Suter [Fri, 20 Sep 2019 08:24:06 +0000 (10:24 +0200)]
Merge branch 'master' into disk

9 months agorework a bit and typo fixes
Frederic Suter [Fri, 20 Sep 2019 07:44:25 +0000 (09:44 +0200)]
rework a bit and typo fixes

9 months agoupdate documentation
Frederic Suter [Thu, 19 Sep 2019 16:14:27 +0000 (18:14 +0200)]
update documentation

9 months agoMerge branch 'master' into disk
Frederic Suter [Thu, 19 Sep 2019 14:55:43 +0000 (16:55 +0200)]
Merge branch 'master' into disk

9 months agofix formatting
Frederic Suter [Thu, 19 Sep 2019 14:54:56 +0000 (16:54 +0200)]
fix formatting

9 months agoadding a test to check if the NS-3 bindings can handle flows that simultaneously end
bcamus [Thu, 19 Sep 2019 14:21:12 +0000 (16:21 +0200)]
adding a test to check if the NS-3 bindings can handle flows that simultaneously end

9 months agoUnblock the number of communications that can be done with NS-3 by
bcamus [Thu, 19 Sep 2019 09:51:22 +0000 (11:51 +0200)]
Unblock the number of communications that can be done with NS-3 by
  + looping on the ports used to communicate,
  + and closing the sockets on the receiver sides (nb. the senders sockets were already closed). This point also improves the NS-3 bindings performance.

9 months agowrote a small blurb to explain the TCP model in practice
Frederic Suter [Thu, 19 Sep 2019 09:30:02 +0000 (11:30 +0200)]
wrote a small blurb to explain the TCP model in practice

9 months agoI am so sorry.
Martin Quinson [Wed, 18 Sep 2019 18:37:57 +0000 (20:37 +0200)]
I am so sorry.

9 months agoTo detect all the flows that are finishing at the same time, allow NS-3 to have a...
bcamus [Tue, 17 Sep 2019 13:54:24 +0000 (15:54 +0200)]
To detect all the flows that are finishing at the same time, allow NS-3 to have a next_occuring_event of 0.
To avoid inconsistencies between SimGrid actions and NS3 flows, set the remainings of an action to 0 only when its flow is finished in NS3

9 months agoconvert a last s4u test to disks
Frederic Suter [Tue, 17 Sep 2019 11:45:44 +0000 (13:45 +0200)]
convert a last s4u test to disks

9 months agoanother test conversion to disks
Frederic Suter [Tue, 17 Sep 2019 07:34:49 +0000 (09:34 +0200)]
another test conversion to disks

9 months agoAlign Disk get/set_data() with the Extendable version of that feature
Frederic Suter [Tue, 17 Sep 2019 07:07:08 +0000 (09:07 +0200)]
Align Disk get/set_data() with the Extendable version of that feature

9 months agoMerge branch 'master' into disk
Frederic Suter [Tue, 17 Sep 2019 06:58:10 +0000 (08:58 +0200)]
Merge branch 'master' into disk

9 months agoremove another pimpl in smpi initialization
Martin Quinson [Mon, 16 Sep 2019 22:14:16 +0000 (00:14 +0200)]
remove another pimpl in smpi initialization

9 months agosmpi: get ride of process_data and use a regular Extension
Martin Quinson [Mon, 16 Sep 2019 21:51:51 +0000 (23:51 +0200)]
smpi: get ride of process_data and use a regular Extension

9 months agoRevert "debug a problem making LSAN to segfault"
Martin Quinson [Mon, 16 Sep 2019 20:34:56 +0000 (22:34 +0200)]
Revert "debug a problem making LSAN to segfault"

The new information are not very informative, and break many tests
that were working.

This reverts commit 219b128344e14ff691c5f9615741d006ac79aeec.

9 months agorevalidate java examples
Frederic Suter [Mon, 16 Sep 2019 15:20:10 +0000 (17:20 +0200)]
revalidate java examples

9 months agofix distcheck and doc
Frederic Suter [Mon, 16 Sep 2019 14:34:47 +0000 (16:34 +0200)]
fix distcheck and doc

9 months agorework that test too (no windows stuff and no tabs)
Frederic Suter [Mon, 16 Sep 2019 14:32:39 +0000 (16:32 +0200)]
rework that test too (no windows stuff and no tabs)

9 months agodo not use win_storage_content.txt anymore
Frederic Suter [Mon, 16 Sep 2019 14:18:32 +0000 (16:18 +0200)]
do not use win_storage_content.txt anymore

9 months agoreplay-storage becomes replay-io ... with disks
Frederic Suter [Mon, 16 Sep 2019 14:05:13 +0000 (16:05 +0200)]
replay-storage becomes replay-io ... with disks

9 months agorework old storage example to get rid of win_storage_content.txt
Frederic Suter [Mon, 16 Sep 2019 13:36:17 +0000 (15:36 +0200)]
rework old storage example to get rid of win_storage_content.txt

9 months agouse smaller file
Frederic Suter [Mon, 16 Sep 2019 13:16:27 +0000 (15:16 +0200)]
use smaller file

9 months agoget rid of this example
Frederic Suter [Mon, 16 Sep 2019 11:26:45 +0000 (13:26 +0200)]
get rid of this example
we have its MSG counterpart in teshsuite

9 months agoplease 32-bit
Frederic Suter [Mon, 16 Sep 2019 11:25:57 +0000 (13:25 +0200)]
please 32-bit

9 months agorevalidate last smpi-io test
Frederic Suter [Mon, 16 Sep 2019 10:15:25 +0000 (12:15 +0200)]
revalidate last smpi-io test

location of disk changed when moving from remote_io.xml to
hosts_with_disks.xml (located on bob while on carl before). The shared
file is now opened locally by bob (was opened remotely on carl before)
and the recessary data transfers for remote accesses change to.
If we switch carl and bob in hostfile_io we observe the same behavior
as before, only the hostnames differ.

9 months agotake change of signal location into account
Frederic Suter [Mon, 16 Sep 2019 09:56:59 +0000 (11:56 +0200)]
take change of signal location into account

9 months agoMerge branch 'master' into disk
Frederic Suter [Mon, 16 Sep 2019 09:28:01 +0000 (11:28 +0200)]
Merge branch 'master' into disk

9 months agolet all but io-shared smpi-io tests use the hosts_with_disks platform
Frederic Suter [Mon, 16 Sep 2019 09:26:53 +0000 (11:26 +0200)]
let all but io-shared smpi-io tests use the hosts_with_disks platform
file.

9 months agoallows for mount of remote disks in file system plugin
Frederic Suter [Mon, 16 Sep 2019 09:17:14 +0000 (11:17 +0200)]
allows for mount of remote disks in file system plugin

* host has to declare a <prop> in the platform file whose id is
"remote_disk" and value has the following format
"mount_point:disk_name:host_name"
* Extend the io-file-remote example and the hosts_with_disks.xml
platform file to test this feature

9 months agodebug a problem making LSAN to segfault
Martin Quinson [Sun, 15 Sep 2019 20:24:32 +0000 (22:24 +0200)]
debug a problem making LSAN to segfault

9 months agodocument existing coding convention in C, and stick to it
Martin Quinson [Sun, 15 Sep 2019 08:31:18 +0000 (10:31 +0200)]
document existing coding convention in C, and stick to it

9 months agoAdd sg_actor_{get,set}_data()
Martin Quinson [Sun, 15 Sep 2019 08:18:55 +0000 (10:18 +0200)]
Add sg_actor_{get,set}_data()

This fixes https://framagit.org/simgrid/simgrid/issues/31

10 months agoAlign Link get/set_data() with the Extendable version of that feature
Martin Quinson [Sat, 14 Sep 2019 21:00:43 +0000 (23:00 +0200)]
Align Link get/set_data() with the Extendable version of that feature

10 months agoAlign Storage get/set_data() with the Extendable version of that feature
Martin Quinson [Sat, 14 Sep 2019 20:53:03 +0000 (22:53 +0200)]
Align Storage get/set_data() with the Extendable version of that feature

That was easy.

10 months agoAlign host get/set_data() with the Extendable version of that feature
Martin Quinson [Sat, 14 Sep 2019 20:42:53 +0000 (22:42 +0200)]
Align host get/set_data() with the Extendable version of that feature

10 months agogive a set_data() and get_data() to all xbt::Extendable structures
Martin Quinson [Sat, 14 Sep 2019 19:43:21 +0000 (21:43 +0200)]
give a set_data() and get_data() to all xbt::Extendable structures

This is for C users, and it will unify all versions of the same
feature all over the place.

10 months agomove some global signals to the Engine
Martin Quinson [Fri, 13 Sep 2019 14:20:06 +0000 (16:20 +0200)]
move some global signals to the Engine

10 months agotry to reduce the memory consistency requirements in the actor refcounting
Martin Quinson [Fri, 13 Sep 2019 09:20:47 +0000 (11:20 +0200)]
try to reduce the memory consistency requirements in the actor refcounting

some people actually seem to like those C++'s hardcore brain teasers

10 months agoMC: rename some methods to make their intent clear
Martin Quinson [Wed, 11 Sep 2019 23:31:35 +0000 (01:31 +0200)]
MC: rename some methods to make their intent clear

10 months agodocument intent of that test
Martin Quinson [Wed, 11 Sep 2019 23:31:01 +0000 (01:31 +0200)]
document intent of that test

10 months agoharden fortran builds to please debian
Martin Quinson [Mon, 9 Sep 2019 06:42:25 +0000 (08:42 +0200)]
harden fortran builds to please debian

10 months agoplease 32-bit
Frederic Suter [Thu, 12 Sep 2019 15:09:54 +0000 (17:09 +0200)]
please 32-bit

10 months agoadd default values for disk properties in file system plugin
Frederic Suter [Thu, 12 Sep 2019 13:22:54 +0000 (15:22 +0200)]
add default values for disk properties in file system plugin

If no <prop> are given for keys "size" and "mount" the following
default values are used:
* 500GiB for "size"
* "/" for "mount"

The third property "content" remains fully optional. If this prop is
not set, the disk is considered as empty.

10 months agorework example
Frederic Suter [Thu, 12 Sep 2019 11:34:32 +0000 (13:34 +0200)]
rework example
* test "/" as mount point
* get rid of this windows style file naming

10 months agohandle special case of '/' as mount point
Frederic Suter [Thu, 12 Sep 2019 11:34:12 +0000 (13:34 +0200)]
handle special case of '/' as mount point

10 months agoMerge branch 'master' into disk
Frederic Suter [Wed, 11 Sep 2019 13:20:23 +0000 (15:20 +0200)]
Merge branch 'master' into disk

10 months agoenable remote copy and move for disks
Frederic Suter [Wed, 11 Sep 2019 13:16:53 +0000 (15:16 +0200)]
enable remote copy and move for disks
* need to have a local disk on both sides. it amounts to reading on
one side, sending the read data and writing it on the other side.
* seemless remote accesses for read and write are no longer available.
* simplify the s4u-file-remote test (remote operations with storage is
still tested in teshsuite by an old MSG test)

10 months agoremove codacy.
Augustin Degomme [Wed, 11 Sep 2019 12:52:33 +0000 (14:52 +0200)]
remove codacy.
It was redundant and the project was deactivated on the website.

10 months agoMerge branch 'master' into disk
Frederic Suter [Tue, 10 Sep 2019 12:14:28 +0000 (14:14 +0200)]
Merge branch 'master' into disk

10 months agopartially handle disks in file system plugin
Frederic Suter [Tue, 10 Sep 2019 12:08:53 +0000 (14:08 +0200)]
partially handle disks in file system plugin
* open/read/write/move/close/unlink
* remote read/write operations not supported yet
* update the s4u-io-file-system example
* To be used with this plugin, a <disk> has to declare some <props>
   * size (with unit) [mandatory]
   * mount            [mandatory]
   * content          [optional]
* TODO
   * write some documentation
   * add some checks/asserts if user tries to
      * use plugin with no <prop> declared
      * mix disk and storage

10 months agoMerge branch 'master' into 'master'
Martin Quinson [Tue, 10 Sep 2019 11:40:32 +0000 (13:40 +0200)]
Merge branch 'master' into 'master'

Fix the NS3 bindings to detect when several flows are simultaneously finishing

See merge request simgrid/simgrid!16

10 months agoDisks do not need this
Frederic Suter [Tue, 10 Sep 2019 10:42:57 +0000 (12:42 +0200)]
Disks do not need this

10 months agoneed to delay signal after properties are set
Frederic Suter [Tue, 10 Sep 2019 09:12:16 +0000 (11:12 +0200)]
need to delay signal after properties are set

10 months agoTo stop NS3 in a consistant state at its next occuring event time, make sure it has...
bcamus [Tue, 10 Sep 2019 08:39:59 +0000 (10:39 +0200)]
To stop NS3 in a consistant state at its next occuring event time, make sure it has processed all the flows that are finishing at this time.

10 months agoextend platorm with disks
Frederic Suter [Mon, 9 Sep 2019 12:09:50 +0000 (14:09 +0200)]
extend platorm with disks
* have two disks on bob
* share same disk name between bob and alice
* revalidate tesh files after modifications

10 months agosimplify disk management
Frederic Suter [Mon, 9 Sep 2019 11:53:37 +0000 (13:53 +0200)]
simplify disk management
* disks are related to a given host, there is no need to maintain a
global map.
* No more map means no by_name methods
* This allows for same name for disks on different hosts

10 months agocosmetics in the wanna be MC's simcall observer
Martin Quinson [Mon, 9 Sep 2019 00:18:06 +0000 (02:18 +0200)]
cosmetics in the wanna be MC's simcall observer

10 months agoimprove the doc of the MC reduction technics
Martin Quinson [Sun, 8 Sep 2019 23:55:31 +0000 (01:55 +0200)]
improve the doc of the MC reduction technics

10 months agoMerge branch 'master' into disk
Frederic Suter [Fri, 6 Sep 2019 15:22:14 +0000 (17:22 +0200)]
Merge branch 'master' into disk

10 months agoWifi: Clean obsolete code
Loic Guegan [Fri, 6 Sep 2019 10:45:37 +0000 (12:45 +0200)]
Wifi: Clean obsolete code

10 months agoWifi: Add crosstraffic on WIFI cells
Loic Guegan [Fri, 6 Sep 2019 09:44:30 +0000 (11:44 +0200)]
Wifi: Add crosstraffic on WIFI cells