X-Git-Url: http://info.iut-bm.univ-fcomte.fr/pub/gitweb/simgrid.git/blobdiff_plain/25640a21a7ea2b5283d7db306491d770ff87b81c..34b1612aaf4fb4375dc39f42941027e56b80aafa:/ChangeLog diff --git a/ChangeLog b/ChangeLog index 76fb5669e8..41bc62f20a 100644 --- a/ChangeLog +++ b/ChangeLog @@ -1,8 +1,185 @@ -SimGrid (3.30.1) NOT RELEASED YET (v3.31 expected March 20. 2022, 15:33 UTC) +SimGrid (3.32.1) not released yet (target december 22) + +General: + - Remove the MSG API: its EOL was scheduled for 2020. + - Remove the Java bindings: they were limited to the MSG interface. + - On Windows, you now need to install WSL2 as the native builds are now disabled. + It was not really working anyway. + - Support for 32bits architecture is not tested anymore on our CI infrastructure. + It may break in the future, but we think that nobody's using SimGrid on 32 bits. + - Remove the surf module. It was replaced by the kernel/models module, and that + refactoring took almost 10 years to properly complete. + +S4U: + - Activity::set_remaining() is not public anymore. Use for example + Comm::set_payload_size() to change the size of the simulated data. + - New function: Engine::flatify_platform(), to get a fully detailed vision of the + configured platform. + - Full simDAG integration: Activity::start() actually starts only when all dependencies + are fullfiled. If it cannot be started right away, it will start as soon as it becomes + possible. + +Kernel: + - optimize an internal datastructure (use a set instead of a list for ongoing activities), + leading to a potentially big performance gain, in particular with many detached comms. + +MPI: + - New option smpi/barrier-collectives to add a barrier to some collectives + to detect dangerous code that /may/ work on some MPI implems. + - New function SMPI_app_instance_start() to easily start a MPI instance in your S4U simulation. + +Models: + - Write the section of the manual about models, at least. + - WiFi: the total capacity of a link depends on the amout of flows on that link. + - Use the nonlinear callback feature of LMM to reflect this. + - Calibration values can be changed to match different MCS configurations + - See the example teshsuite/models/wifi_usage_decay/wifi_usage_decay.cpp + - See also "A Flow-Level Wi-Fi Model for Large Scale Network Simulation" + https://hal.archives-ouvertes.fr/hal-03777726 + - Merge parameters network/bandwidth-factor and smpi/bw-factor that serve the same purpose. + - Same for the latency + - Rewrite the corresponding documentation. + - Allow to disable the TCP windowing modeling by setting network/TCP-gamma to 0. + - Finally kill the 'compound' host model. You can change the CPU or network model + with the default host model, as it should. + - Rename option "surf/precision" to "precision/timing" for clarity. + - Rename option "maxmin/precision" to "precision/work-amount" for clarity. + - New function: Engine::flatify_platform() to debug your platform. + +sthread: + - Implement pthread_join in MC mode. + - Implement semaphore functions in sthread. + - Add an intricated way to verify the access to non-reentrant data structures + It requires code annotation, as shown in examples/sthread/stdobject/stdobject.cpp + +Model checking: + - Synchronize the MBI tests with upstream. + - Show the full actor bactraces when replaying a MC trace (with model-check/replay) + and the status of all actors on deadlocks in MC mode. + +XBT: + - simgrid::xbt::cmdline and simgrid::xbt::binary_name are gone. + Please use simgrid::s4u::Engine::get_cmdline() instead. + +Documentation: + - New section in the user guide on the provided performance models. + - New section presenting some technical good practices for (potential) contributors. + - Add a section on errors and exceptions to the API documentation. + - Move the s4u examples to a section on their own to ease navigation. + +Fixed bugs (FG#.. -> FramaGit bugs; FG!.. -> FG merge requests) + (FG: issues on Framagit; GH: issues on GitHub) + - FG#18: Java bindings should be redone or removed + - FG!118: Wi-Fi callback mechanism + - FG!119: SMPI: add option to inject a barrier before every collective call + - GH#383: Segfault when adding a disk after load_platform(xml) + +---------------------------------------------------------------------------- + +SimGrid (3.32) October 3. 2022. + +The Wiedervereinigung release. Germany was reunited 32 years ago. + +General: + - SimGrid now requires a compiler with C++17 support to compile the lib. + Our public headers still allow the user code to be compiled in C++14. + - Support graphviz v3 and ns-3 v3.36 (older versions are still supported). + - Tested with clang (v11, v13, v14 and v16), gcc (v7 to v13) and IntelCC v2022.2 + +S4U: + - API evolutions: + - kill signal Comm::on_completion that was not working anyway. + - Expose signals Activity::on_suspend and Activity::on_resume + - New macro xbt_enforce(): similar to xbt_assert(), but throws an AssertionError + instead of calling abort(). + - New: s4u::Exec::get_thread_count() + - Various cleanups around virtual machines: + - host_by_name() and friends now only return hosts. VMs are now excluded. + - It is now impossible to search a VM by name globally. + You can only search VM by name on a given PM, so either you know + the PM on which your VM runs and you can search by name, or you need + to manually iterate over all PMs to search this VM. + - The s4u::VirtualMachine constructor is now deprecated. + Please use s4u::Host::create_vm() instead. + - Rename s4u::VirtualMachine::on_creation() to on_vm_creation() to + avoid confusion with s4u:Host::on_creation() that is inherited. + Also s4u::VirtualMachine::on_destruction -> on_vm_destruction(). + - Bug fixes: + - One-sided communications (Comm::sendto) can now be detached, + and should now be more resilient to network and host faults. + +Python: + - Added the following bindings / examples: + - Comm (now 100% covers the C++ interface): + - Comm.dst_data_size, Comm.mailbox, Comm.sender, Comm.start_time, Comm.finish_time + - Comm.state_str [examples: examples/python/comm-failure/, examples/python/comm-host2host/] + - Comm.remaining [examples: examples/python/comm-host2host/, examples/python/comm-suspend/] + - Comm.set_payload_size [example: examples/python/comm-host2host/] + - Comm.set_rate [example: examples/python/comm-throttling/] + - Comm.sendto, Comm.sendto_init, Comm.sendto_async [example: examples/python/comm-host2host/] + - Comm.start, Comm.suspend, Comm.resume [example: examples/python/comm-host2host/] + - Comm.test_any [example: examples/python/comm-testany/] + - Comm.wait_until [example: examples/python/comm-waituntil/] + - Engine: + - Engine.host_by_name [example: examples/python/comm-host2host/] + - Engine.mailbox_by_name_or_create [example: examples/python/comm-pingpong/] + - Engine.set_config + - Mailbox: Mailbox.ready [example: examples/python/comm-ready/] + - Ptask [example: examples/python/exec-ptask/]: + - this_actor.exec_init + - this_actor.parallel_execute + - Exec.suspend + - Exec.wait_for + - Added an AssertionError exception that may be thrown in case of error. + For instance, creating two hosts with the same name will now throw this exception + instead of killing the interpreter. + +SMPI: + - Implement MPI_File_get_type_extent(), MPI_File_s/get_atomicity() and + MPI_File_get_byte_offset() + - Intercept getpid() calls to return the simulated ones. + - Fix various bugs in MPI IO. + +Platform description & visualization: + - More robust sanity checks for platforms, to reject forbidden topologies with + a proper error message. + - New platform example: supernode.cpp and supernode.py. + The Python version generates a nice graphical representation of the platform. + - Bug fixes around fat-tree topologies. + - Allow to dump the platform topology as a CSV file representing the graph edges + with platform_graph_export_csv() (similar to the DOT export). + - Fix graphicator for "cluster" topologies (e.g. fat-tree, dragonfly). + +Models: + - Fix a bug when using ptasks with multicores (FG!111). + +Model-Checker: + - First bits of sthread, that intercepts pthread operations at runtime. + The intend is to use it together with simgrid-mc, but it is TBD. + - Sync MBI generators with upstream changes. + - Various cosmetics, small bug fixes and inner refactorings + +Fixed bugs (FG#.. -> FramaGit bugs; FG!.. -> FG merge requests) + (FG: issues on Framagit; GH: issues on GitHub) + - FG#105: "Variable penalty should not be negative!" with in-flight messages and bandwidth profiles + - FG#109: Application time reported by --cfg=smpi/display-timing:yes is wrong + - FG#110: Wait_any does not trigger new model solve when host events occur + - FG#111: Wrong execution time in rare cases when using multicore + - FG!98: Re-enable the tests for legacy stochastic profiles + - FG!109: Trigger new engine solve upon host events such as host on/off + - FG!116: SMPI/replay: Fix issue with recv of size =0 + +---------------------------------------------------------------------------- + +SimGrid (3.31) March 22. 2022. + +The ненасильство release. We stand against war. + +Against the agression by a sick system that forces peoples to take arms against each other. MC: - Rework the internals, for simpler and modern code. This shall unlock many future improvements. - - You can now define plugins onto the DFS explorer (previously called SafetyChecker), using the + - You can now define plugins onto the DFS explorer (previously called SafetyChecker), using the declared signals. See CommunicationDeterminism for an example. - Support mutex, semaphore and barrier in DPOR reduction - Seems to work on Arm64 architectures too. @@ -18,15 +195,18 @@ SMPI: - tracing: ensure that we dump the TI traces continuously during execution and not just at the end, reducing memory cost and performance hit. - Update OpenMPI collectives selection logic to match current one (4.1.2) + - Add a coherence check for collective operation order and root/MPI_Op + coherence. Potentially costly so not activated unless smpi:pendantic is set + or -analyze is given. S4U: - New signal: Engine::on_simulation_start_cb() - - Introduce a new execution mode with this_actor::thread_execute(). This simulate + - Introduce a new execution mode with this_actor::thread_execute(). This simulate the execution of a certain amount of flops by multiple threads ran by a host. Each thread executes the same number of flops, given as argument. An example of this new function can be found in examples/cpp/exec-threads. - - Reimplementation of barriers natively. - Previously, they were implemented on top of s4u::Mutex and s4u::ConditionVariable. + - Reimplementation of barriers natively. + Previously, they were implemented on top of s4u::Mutex and s4u::ConditionVariable. The new version should be faster (and can be used in the model-checker). - Actor::get_restart_count(): Returns the number of reboots that this actor did. @@ -34,34 +214,31 @@ MSG: - MSG_barrier_destroy now expects a non-const msg_barrier parameter. New plugin: the Chaos Monkey (killing actors at any time) - - Along with the new simgrid-monkey script, it tests whether your simulation - resists resource failures at any possible timestamp in your simulation. - - It is mostly intended to test the simgrid core in extreme conditions, + - Along with the new simgrid-monkey script, it tests whether your simulation + resists resource failures at any possible timestamp in your simulation. + - It is mostly intended to test the simgrid core in extreme conditions, but some users may find it interesting too. Models: - - New model for parallel task: ptask_BMF. - - More realistic sharing of heterogeneous resources compared to ptask_L07. + - New solver for parallel task: BMF. + - More realistic sharing of heterogeneous resources compared to the fair + bottleneck solver used by ptask_L07. - Implement the BMF (Bottleneck max fairness) fairness. - Improved resource sharing for parallel tasks with sub-flows (parallel - communications between same source and destination inside the ptask). + communications between same source and destination inside the ptask). - Parameters: - - "--cfg=host/model:ptask_BMF": enable the model. - - "--cfg=bmf/max-iterations: " - maximum number of iterations performed - by BMF solver (default: 1000). - - "--cfg=bmf/selective-update:" - enable/disable the - selective-update optimization. Only invalidates and recomputes modified - parts of inequations system. May speed up simulation if sparse resource - utilization (default: false). - - ATTENTION: this model requires Eigen3 library. If you install SimGrid - from source, please see the "Installing from source" section: - https://simgrid.org/doc/latest/Installing_SimGrid.html#installing-from-the-source. - No action is required if you use pre-compiled packages. + - "--cfg=host/model:ptask_L07 --cfg=host/solver:bmf": enable the ptask + model with BMF solver. + - "--cfg=bmf/max-iterations: ": maximum number of iterations performed + by BMF solver (default: 1000). + - "--cfg=bmf/precision: ": numerical precision used when computing + resource sharing (default: 1e-12). + - This model requires Eigen3 library. Make sure Eigen3 is installed to use BMF. General: - - Modifications of the Profile mechanism, with some impact on users + - Modifications of the Profile mechanism, with some impact on users - Addition of a new (S4U) method to init profiles from generic functions to improve versatility - - Fix initial behaviour of state_profiles + - Fix initial behaviour of state_profiles - Modify periodicity to behave like a period, and not like a loop delay XBT: @@ -80,6 +257,8 @@ Python: - Comm.wait_any_for() - Comm.wait_all_for() [example: examples/python/comm-waitallfor/] - Mutex [example: examples/python/synchro-mutex/] + - Barrier [example: examples/python/synchro-barrier/] + - Semaphore [example: examples/python/synchro-semaphore/] Build System: - Remove target "make uninstall" which was incomplete and no longer maintained. @@ -177,7 +356,6 @@ The "Ask a stupid question" release. We wish that every user ask one question about SimGrid to celebrate. On Mattermost, Stack Overflow or using the issues tracker. - New modeling features: - Non-linear resource sharing, modeling resources whose performance heavily degrades with contention: - The total capacity may be updated dynamically through a callback