1
1
openmpi/orte/mca/ras
Ralph Castain 12cd07c9a9 Start reducing our dependency on the event library by removing at least one instance where we use it to redirect the program counter. Rolf reported occasional hangs of mpirun in very specific circumstances after all daemons were done. A review of MTT results indicates this may have been happening more generally in a small fraction of cases.
The problem was tracked to use of the grpcomm.onesided_barrier to control daemon/mpirun termination. This relied on messaging -and- required that the program counter jump from the errmgr back to grpcomm. On rare occasions, this jump did not occur, causing mpirun to hang.

This patch looks more invasive than it is - most of the affected files simply had one or two lines removed. The essence of the change is:

* pulled the job_complete and quit routines out of orterun and orted_main and put them in a common place

* modified the errmgr to directly call the new routines when termination is detected

* removed the grpcomm.onesided_barrier and its associated RML tag

* add a new "num_routes" API to the routed framework that reports back the number of dependent routes. When route_lost is called, the daemon's list of "children" is checked and adjusted if that route went to a "leaf" in the routing tree

* use connection termination between daemons to track rollup of the daemon tree. Daemons and HNP now terminate once num_routes returns zero

Also picked up in this commit is the addition of a new bool flag to the app_context struct, and increasing the job_control field from 8 to 16 bits. Both trivial.

This commit was SVN r23429.
2010-07-17 21:03:27 +00:00
..
alps Allow the ALPS allocator to run if the BASIL_RESERVATION_ID has been set. Update show_help messages and comments to reflect this new scenario. 2010-07-12 15:42:25 +00:00
base Start reducing our dependency on the event library by removing at least one instance where we use it to redirect the program counter. Rolf reported occasional hangs of mpirun in very specific circumstances after all daemons were done. A review of MTT results indicates this may have been happening more generally in a small fraction of cases. 2010-07-17 21:03:27 +00:00
bjs Courtesy of Ralph and Jeff: 2009-10-24 01:04:35 +00:00
ccp Add a global option for inputing the head node name for Windows CCP trough command line. 2010-02-23 19:42:51 +00:00
gridengine Fix broken compile. 2010-05-18 12:43:21 +00:00
loadleveler IBM has approved the release of the LoadLeveler sample code under the 2010-04-08 19:41:44 +00:00
lsf Courtesy of Ralph and Jeff: 2009-10-24 01:04:35 +00:00
slurm * Wrap all the direct error-code checks of the form (OMPI_ERR_* == ret) with 2010-05-17 23:08:56 +00:00
tm Courtesy of Ralph and Jeff: 2009-10-24 01:04:35 +00:00
Makefile.am Establish an MCA param "orte_allocation_required" so that a system can require the user have an RM-provided allocation in order to run. This helps prevent the problem where a user forgets to get an allocation on an RM-managed cluster, and then executes mpirun on the head node - thus causing all of their mpi procs to launch on the head node, usually bringing it to its knees. 2008-08-04 14:25:19 +00:00
ras_types.h Merge the ORTE devel branch into the main trunk. Details of what this means will be circulated separately. 2008-02-28 01:57:57 +00:00
ras.h Fixes trac:1392, #1400 2008-07-28 22:40:57 +00:00