X-Git-Url: http://info.iut-bm.univ-fcomte.fr/pub/gitweb/simgrid.git/blobdiff_plain/62e8c6c400739e02fa44461fb9e59f3f2d904590..86aca0bc9a0862b9bf2bcff1c6a50f875bb71a98:/ChangeLog diff --git a/ChangeLog b/ChangeLog index bfb285b8c4..c53ae08349 100644 --- a/ChangeLog +++ b/ChangeLog @@ -1,26 +1,254 @@ -SimGrid (3.5) unstable; urgency=low +SimGrid (3.7) unstable; urgency=low + + -- `LC_ALL=C date` Da SimGrid team + SIMDAG + [dot loader] + * Bug fix: correction of the dot file parsing with the libcgraph + + +SimGrid (3.6.1) unstable; urgency=low + + The "Oops, we broke Macs too" release + + Portability + * Fixed contextes detection so that raw ones are used when possible + * On Mac, do not use Posix Ucontextes with gcc v4.[1-5] since this + leads to a strange error, with user code segfaulting sometimes when + the generated code is not perfectly aligned (which is not + controlable from the user side, depends on the amount of code) + + XBT + * New macro: CATCH_ANONYMOUS, which is like CATCH(e) but without argument. + + -- Mon Jun 27 13:59:03 CEST 2011 Da SimGrid team + +SimGrid (3.6) stable; urgency=medium + + The Summer Release, also known as the "OMG! They Killed Kenny!" version + + Java and Ruby: + * Bindings now constitute their own package, separated from the main one. + Rationale: reduce our maintainance nightmare by reducing the module coupling + They will soon be released on their own on gforge. + * In the meanwhile: + svn co svn://scm.gforge.inria.fr/svn/simgrid/contrib/trunk/simgrid-java + svn co svn://scm.gforge.inria.fr/svn/simgrid/contrib/trunk/simgrid-ruby + + GRAS: It is not considered as stable anymore, but experimental. Sorry. + * It's not quite deprecated for now because we have no replacement, + but it may soon become the case. + + SMPI + * New MPI functions supported: MPI_Comm_disconnect, MPI_Comm_get_name + * Fortran: New user-level cache variable to store the rank of the running + process. This improves performance by an order of magnitude. + * C: New coccinelle script to automatically locate and modifiy global and + local static variables. + * Improved SMPI network model with a sender-side gap to account for multiple + parallel sends. + + MSG + * New function MSG_comm_get_status(). MSG_comm_test() and MSG_comm_testany() + only say if a communication is finished, no matter whether it succeeded or + failed. You can call MSG_comm_get_status() to know the status of a finished + communication. + * New function MSG_task_dsend() to send a task and detach it. When a + communication is detached, you are never notified of its success or failure + and the memory is released automatically once it is finished. This function + is useful when you don't care about the end nor the success of a + communication. + * Change the prototypes of action replay. Sorry for inconvenience, + but this is really more efficient this way (and to adapt your code, + you just have to fix the initialization, that shouldn't be too long) + * Kill the braindead MSG_task_refcount_dec() function. I guess nobody + ever managed to do anything useful with it. + * New function MSG_comm_testany(). Similarly to MSG_comm_waitany(), it + takes a dynar of communications. It returns immediately and gives the + index of a finished communication (if any). + * New example: a basic implementation of the Chord P2P algorithm. + + SURF + * New model for multi-core CPUs. You can now use the core attribute to + precise the number of cores of a host. This is a basic model. Every + process running on the host receives at most the power provided in + the DTD (throughput<=power). Total throughput of process cannot exceed + power * num_cores. + * New peer tag. This peer tag creates a tiny AS comprising a host and a + router linked by an up-link and a down-link (possibly asymmetrical). + This kind of pattern allows to easily build last-mile model style platforms. + Aggregating such patterns in a rule-based AS is thus the technique of + choice for modeling large peer-to-peer/volunteer computing/cloud platforms. + * New model for Vivaldi routing. We transformed the Vivaldi network model + into a Vivaldi routing model (based on the rule-based model). This allows to + combine Vivaldi based latencies with last-mile platforms. + + SIMIX + * Introduce a new context factory "raw", highly inspirated from the + ucontext factory, but using manually crafted functions in assembly to + do the work in an efficient manner. + * Allow to change the used context factory at run time, not only at + compilation time. Use --cfg=contexts/factory:raw for maximal speed. + * Add an option --cfg=contexts/stacksize:N to set the stack size of the user + contextes at runtime (only with raw contexts or ucontexts). + * Completely rewrote this module to allow parallel execution of user + processes. Use --cfg=contexts/nthreads:N to execute user processes + with N parallel threads (the default is 1, meaning no parallelism). + * Allow to decide dynamically between sequential and parallel modes. + When nthreads > 1, you can use --cfg=contexts/threshold:P to run the user + processes in parallel only when their number is greater than or equal to P + (the default is 2). + * Added a check for NaN of IEEE754 infinite in the double entries of + the smx_user.c file + + XBT + * New command line option: if you pass --cfg=verbose-exit:0, SimGrid + won't output the state of processes when interrupted with Ctrl-C + * Add a new function xbt_dynar_to_array that transforms a dynar into a + NULL-terminated array. This may solve backward compatibility issues + due to the change to return type of SD_simulate. See also: + http://lists.gforge.inria.fr/pipermail/simgrid-user/2010-December/002206.html + * Add new macros with variable number of arguments. + - in xbt/log.h: XBT_DEBUG, XBT_VERB, XBT_INFO, etc. + - in xbt/asserts.h: xbt_assert + - in xbt/cunit.h: xbt_test_{add,fail,assert,log} + - in xbt/ex.h: THROWF and RETHROWF. + Define XBT_USE_DEPRECATED if you want to use the old numbered macros like + INFO1, INFO2, etc. + * Change xbt_die() to accept a format string with arguments, just like printf. + * New data structure: xbt_lib_t, like a dict but more general and with better + memory handling. + + INSTR + * New configuration options + Options triva/categorized and triva/uncategorized can be used to generate + graph configuration files for Triva visualization tool. + * Configuration option tracing/platform is renamed to tracing/categorized + * XBT logging makes tracing error checks easier, new root log hierarchy: instr + * New TRACE_user_link_variable interface: + User provides the name of the link and the tracing variable to attach to it + * the declaration of tracing categories must be done after the environment + creation + * simpler tracing interface, just one way to declare categories + TRACE_category or TRACE_category_with_color, it is up to you + * links in the trace file are again identified by their names + * trace contains the full platform hierarchy exactly as declared using the ASes + * Options tracing/msg/[task|process]:1 groups the process by hosts + for both cases, tasks and processes must have names that are unique during the simulation + these options generate traces that are suited to gantt-charts, such as the space-time view of Paje + * The experimental option tracing/msg/volume is deprecated + its functionality may be reincorporated if needed + * Buffering + The tracing generates a trace file with unordered timestamped events, + because of the way the core simulator (surf) works. A script available + at the tools directory (fix-paje-trace.sh) can be used to put the events + in order. We have changed the tracing so it can generate ordered timestamped + events in the final trace, but depending on the simulator (and how much time + is simulated) that can lead to a huge memory utilization. It is desactivated + by default, but it can be activated using the --cfg=tracing/buffer:1 switch. + + Build Infrastructure + * Define a SIMGRID_VERSION macro in simgrid_config.h. + - We are trying hard to keep the API stable, but it may happen that + some things change (we're a research project after all, not a + nuclear plant operating system). If such things should happen, you + could rely on that macro to adapt. + - current value: 30600 for 3.06.00, aka 3.6 + * Define macro MAKE_SIMGRID_VERSION(major, minor, patch) to help building + a number that can be compared with SIMGRID_VERSION. + * Add a build option -Denable_debug (set to ON by default): when set to OFF, + assertions and verbose/debug logging events are disabled at compile time. + + -- Tue Jun 21 08:57:43 CEST 2011 Da SimGrid team + +SimGrid (3.5) stable; urgency=medium + + Model Checking + * New feature to any SimGrid-based simulator: Model-Checking + Check SIN#1 for more details. + + SMPI + * New Model SMPI (three-interval linear regression for correction factors) + See RR-7426, available at http://hal.inria.fr/inria-00527150 + * Ability to use FORTRAN MPI code (through f2c, automatically privatized) + * New MPI functions supported: MPI_Get_count(), MPI_Comm_split() + * New: RAM folding (see RR-7426 and examples/smpi/NAS/DT-folding) + * New: execution sampling (see RR-7426 and examples/smpi/NAS/EP-sampling) + * See also src/smpi/README + + Tracing: + Tracing: + * Tracing system + - Tracing API changes: TRACE_start and TRACE_end should not be called + by user-code. They are automatically called by simulators created + with SimDAG, MSG and SMPI if the toolkit is compiled with + tracing_enabled=ON. Categories declaration and utilization remain the + same for MSG and SimDag. + - A function was added to the tracing API to declare categories with + colors: + - TRACE_category_with_color (char *category, char *color) + where color must be in the following format + "%f %f %f", red, green, blue + and red, green, blue are float values in the interval [0, 1] + - User can specify NULL as color parameter, or continue calling + TRACE_category (cat) + On that case, the tracing system will define random colors + - The following command-line options are supported: + --cfg=tracing/filename:msg.trace + --cfg=tracing:1 (activate tracing, needed to use others) + --cfg=tracing/platform:1 (categorized resource use) + --cfg=tracing/uncategorized:1 (uncategorized resource use) + --cfg=tracing/msg/task:1 (task creation) + --cfg=tracing/msg/process:1 (process creation, migration) + --cfg=tracing/msg/volume:1 (volume of MSG send/recv) + --cfg=tracing/smpi:1 (SMPI interface tracing) + --cfg=tracing/simdag:1 (allow SimDAG tasks receive categories) + - examples of examples/msg/tracing updated + * Tracing SimDag + - DAXLoader and DOTLoader functions can generate tasks with categories + - A new function to attribute a category to SD tasks: + TRACE_sd_set_task_category (SD_task_t task, char *category) + * Tracing the MPI interface implemented by SMPI + - Collective operations are traced with states + - Point-to-Point operations are traced with states/links + - Tracing activated by a parameter "-trace filename" passed + to smpirun during execution (considering that simgrid + is compiled with tracing enabled) + - To run the simulation with gdb, the simulator + accepts --cfg=tracing/smpi:1 to trace SMPI + - tesh files to check if smpi tracing is ok + - See examples/smpi/NAS/DT-trace + * GTNetS tracing re-worked + - adaptation to the tracing system of GTNets to cope + with modifications regarding the fullduplex mode + - new tesh files to check if gtnets tracing is ok MSG + * Asynchronous communications through the functions: + MSG_task_isend/irecv and MSG_comm_test/wait/waitall * New function: MSG_load_platform_script() to make possible using a lua script instead of XML files to set up platforms * New function: MSG_set_function to associate functions to processes, used when bypassing the parser + * New functions: MSG_task_set_name(), MSG_task_set_compute_duration() - LUA Bindings - * Add layer to set up environment and bypass the XML surf parser - * Modify the entry point, to take into consideration when lua is used only as a platform generator + Platforms: Add some more examples in examples/platforms + * Grid'5000: see www.grid5000.fr + * *_30000_hosts.xml: various huge files [mainly scalability testing] SURF * Change the XML format. This is a very important modification. SimGrid 3.5 introduces a new hierarchical format based on the notion of Autonomous Systems. Compatibility with old format is ensured - through the perl script provided in the install bin directory - bin/simgrid_update_xml.pl. + through the perl script provided in the install bin directory + bin/simgrid_update_xml. It is now possible to build platforms with specific routing mechanism (Full/Dijkstra/DijkstraCache/Floyd) and to easily connect several platforms together. We will try to provide soon set of realistic platforms exploiting these properties (have a look at examples/platforms/ for the moment). + * Take the opportunity of the XML format change to be a good XML citizen: + rename link:ctn to link_ctn and similar changes (also dealed with by + simgrid_update_xml) * Add a new routing scheme (rule-based) using regular expressions. It enables to have an extremely low memory footprint when the underlying routing is simple and can be compactly described. You @@ -31,11 +259,12 @@ SimGrid (3.5) unstable; urgency=low at teshsuite/simdag/platforms/ to see how this can be done. With this tag, you can create clusters with thousands of tasks at no cost (have a look at examples/platforms/). - * Add new callbacks to the CPU & netwok models to create resources - no need to pass through the parser callbacks to do so. - * Add new function to create routes table via the routing model - * Add generic functions in the public interface that allows the user to - call SURF 'create_resource' methods from a lua script. + Note: clusters are implemented as ASes, so there is no need for an + enclosing AS tag if you have only one cluster in your platform. + * Add new generic functions in the public interface that allows the user + to call SURF 'create_resource' methods from your code (same + functionality as the XML bypass mechanism but with a much lighter + burden). * Add a new model (enabled through command line --cfg=network/model:SMPI) that uses a piecewise linear approximation to produce better results when exchanging small messages. @@ -43,98 +272,94 @@ SimGrid (3.5) unstable; urgency=low for interferences between uplink and downlink communications (activate with --cfg=fullduplex:1). - SIMIX - * New function: SIMIX_process_set_function() called by MSG_set_function - * Change the underlying waiting queue in semaphores so that a process - can wait on several of them simultaneously (as in waitany). - * Fix the way to handle tokens in semaphores so that all access patterns - work: {acquire, acquire_timeout, waitany} / {release, release_forever}. - SIMDAG - * Fix a bug in the management of tasks of size 0 in the surf network - models. This problem was only visible with SIMDAG and you should - thus disregard results produced with earlier versions if you - relied on this feature (some tasks were blocked because of this). - * Fix a bunch of stuff that prevented to use classical models with SIMDAG - even though your applications were doing only point-to-point - communications and sequential computations. Now you can really use any - model you want (of course, if you create real parallel tasks, which are - not implemented in most models beside ptaskL07, this will abort). + * Rename the SD_READY (all dependencies are satisfied and task is + scheduled) state in SD_RUNNABLE and define a new SD_SCHEDULABLE (all + dependencies are satisfied) state. + This prevents a confusion between the notion of "ready to schedule" + (SD_SCHEDULABLE) used in DAG scheduling and that of "ready to be + simulated" (SD_RUNNABLE) used by the simulation kernel. * Change the way a task is considered as ready. Instead of removing dependencies when a task is done, a counter is decreased. This way, it is always possible to reach ancestors thanks to the SD_taks_get_parents function (even after the end of the simulation.) - * Change the level of some logs in sd_global from INFO to VERB. The - corresponding tests are now less verbose * Change the return type of SD_Simulate from (SD_task_t*) into xbt_dynar_t. This function was in handling a dynar internally and converted it into a NULL terminated array for historical reasons. - * Rename the SD_READY (all dependencies are satisfied and task is - scheduled) state in SD_RUNNABLE and define a new SD_SCHEDULABLE (all - dependencies are satisfied) state. - This prevents a confusion between the notion of "ready to schedule" - (SD_SCHEDULABLE) used in DAG scheduling and that of "ready to be - simulated" (SD_RUNNABLE) used by the simulation kernel. - * Add an example that scheduling a DAX on an heterogeneous platform - using a Min-Min strategy - * new function SD_dotload(char*) to load a DAG described in dot + * New function SD_dotload(char*) to load a DAG described in dot format. This loader and the corresponding examples require the installation of the graphviz library. + * Fix a bug in the management of tasks of size 0 in the surf network + models. This problem was only visible with SIMDAG and you should + thus disregard results produced with earlier versions if you + relied on this feature (some tasks were blocked because of this). + * Fix a bunch of stuff that prevented to use classical models with SIMDAG + even though your applications were doing only point-to-point + communications and sequential computations. Now you can really use any + model you want (of course, if you create real parallel tasks, which are + not implemented in most models beside ptaskL07, this will abort). + * Add an example that schedules a DAX on an heterogeneous platform + using a Min-Min strategy. + * New function SD_workstation_get_current_task() that returns the kind + of task currently running on a workstation in the sequential access + mode. + * Raise some warnings when unexecuted tasks remains at the end of the + simulation. This is usually caused by cycles in the DAG. + + SIMIX + * New function: SIMIX_process_set_function() called by MSG_set_function + * Change the underlying waiting queue in semaphores so that a process + can wait on several of them simultaneously (as in waitany). + * Fix the way to handle tokens in semaphores so that all access patterns + work: {acquire, acquire_timeout, waitany} / {release, release_forever}. + * kill the dirty pimple SIMIX_message_sizes_output() + Please use (proper) visualization instead XBT * New data container: setset (set of sets of elements) - * New module: mmalloc (mapped malloc) + * New module: mmalloc (mapped malloc, allowing to have several + independent segments of malloc) * New function: xbt_dict_cursor_set_data() - * New function: xbt_dynar_sort() + * New functions: xbt_dynar_sort(), xbt_dynar_compare() * New function: xbt_dynar_is_empty() * New function: xbt_fifo_get_last_item() - * Bug fix in xbt_dynar_shrink(): use the right element size + * Fix xbt_dynar_shrink(): use the right element size. + * Fix xbt_dynar_set*(): allow index larger than current size and memset 0 + uninitialized areas during expand. + * Fix semaphores: previous implementation was severely broken. * Use library init/fini functions for our initialization. - you can use logs and other feature as soon as you want in your code (even before the xbt_init / MSG_init) - xbt_exit is now a no-op and produce a warning when used. GRAS: - * New function: gras_msgtype_get_name() - - Build chain: bug fixes and further polishing + * Port GRAS to new SIMIX mechanisms. This allows gras users to + benefit from the latest improvement to the simulation kernel. + * Kill measurement sockets for now. If you rely on them, sorry. This + release is not for you. This feature will be reintroduced in the + future, but we cannot delay the release any further. + * New function: gras_msgtype_get_name(). + * Implement gras_agent_spawn in RL too (the prototype changed a bit) + * Fix (at last) the pmm example: it should not randomly fail anymore. + + Build chain: bug fixes and overall polishing + * Cmake is now stable enough. Hence, we killed the autotools. + * Port to windows ( TM :) * Fix the 'make install' target. No need to use 'make install-simgrid' anymore * Introduce a 'make dist' target compiling a *source* archive - 'make package' compiles a binary archive (not well tested) + 'make package' compiles a binary archive * Compile java files only on need + * Add --cd and --setenv command line options to tesh + * Out of source builds are not fully supported yet, but we are close + * Enable supernovae and optimization flags by default for our users - Tracing: - * Tracing system - - tracing API for MSG changes: TRACE_start has no - longer parameters, the trace file is supplied through - an option passed to simulator. Categories declaration - and utilization remain the same. The following options - are supported: - --cfg=tracing/filename:msg.trace - --cfg=tracing/platform:1 (categorized resource use) - --cfg=tracing/msg/task:1 (task creation) - --cfg=tracing/msg/process:1 (process creation, migration) - --cfg=tracing/msg/volume:1 (volume of msg send/recv) - --cfg=tracing/smpi:1 (smpi interface tracing) - - examples of examples/msg/tracing updated - - * Tracing the MPI interface implemented by SMPI - - Collective operations are traced with states - - Point-to-Point operations are traced with states/links - - Tracing activated by a parameter "-trace filename" passed - to smpirun during execution (considering that simgrid - is compiled with tracing enabled) - - To run the simulation with gdb, the simulator - accepts --cfg=tracing/smpi:1 to trace SMPI - - tesh files to check if smpi tracing is ok - - * GTNetS tracing re-worked - - adaptation to the tracing system of GTNets to cope - with modifications regarding the fullduplex mode - - new tesh files to check if gtnets tracing is ok + LUA Bindings + * Add layer to set up environment directly from lua, without XML. + * The effect of gras_stub_generator can be achieved through + lua too (check examples/gras/console/ping_generator.lua) - -- Da SimGrid team + -- Wed, 01 Dec 2010 22:09:23 +0100 Da SimGrid team SimGrid (3.4.1) stable; urgency=low