1
1
openmpi/orte/util
Ralph Castain 48fc339718 Create an alternative mapping method that pushes responsibility
onto the backend daemons. By default, let mpirun only pack the app_context
info and send that to the backend daemons where the mapping will
be done. This significantly reduces the computational time on mpirun as it isn't
running up/down the topology tree computing thousands of binding
locations, and it reduces the launch message to a very small number of
bytes.

When running -novm, fall back to the old way of doing things
where mpirun computes the entire map and binding, and then sends
the full info to the backend daemon.

Add a new cmd line option/mca param --fwd-mpirun-port that allows
mpirun to dynamically select a port, but then passes that back to
all the other daemons so they will use that port as a static port
for their own wireup. In this mode, we no longer "phone home" directly
to mpirun, but instead use the static port to wireup at daemon
start. We then use the routing tree to rollup the initial
launch report, and limit the number of open sockets on mpirun's node.

Update ras simulator to track the new nidmap code

Cleanup some bugs in the nidmap regex code, and enhance the error message for not enough slots to include the host on which the problem is found.

Update gadget platform file

Initialize the range count when starting a new range

Fix the no-np case in managed allocation

Ensure DVM node usage gets cleaned up after each job

Update scaling.pl script to use --fwd-mpirun-port. Pre-connect the daemon to its parent during launch while we are otherwise waiting for the daemon's children to send their "phone home" rollup messages

Signed-off-by: Ralph Castain <rhc@open-mpi.org>
2017-03-07 20:43:12 -08:00
..
comm Revise the routed framework to be multi-select so it can support the new conduit system. Update all calls to rml.send* to the new syntax. Define an orte_mgmt_conduit for admin and IOF messages, and an orte_coll_conduit for all collective operations (e.g., xcast, modex, and barrier). 2016-10-23 21:52:39 -07:00
dash_host Fix launch_id matching of -hosts 2017-02-20 07:03:53 -08:00
hostfile util/hostfile: plug a memory leak 2017-01-06 15:38:45 +09:00
attr.c Deprecate the --slot-list paramaeter in favor of --cpu-list. Remove the --cpu-set param (mark it as deprecated) and use --cpu-list instead as it was confusing having the two params. The --cpu-list param defines the cpus to be used by procs of this job, and the binding policy will be overlayed on top of it. 2017-01-24 13:33:22 -08:00
attr.h Create an alternative mapping method that pushes responsibility 2017-03-07 20:43:12 -08:00
compress.c orte/util: fix OPAL_HAVE_ZLIB usage 2017-02-05 16:24:10 +01:00
compress.h Compress the xcast message if bigger than a defined size to further improve launch performance at scale 2017-01-19 22:08:02 -08:00
context_fns.c Silence Coverity warning 2016-03-14 09:42:43 -07:00
context_fns.h Purge whitespace from the repo 2015-06-23 20:59:57 -07:00
error_strings.c Repair rsh/ssh tree spawn 2017-01-27 11:35:00 -08:00
error_strings.h Purge whitespace from the repo 2015-06-23 20:59:57 -07:00
help-regex.txt Purge whitespace from the repo 2015-06-23 20:59:57 -07:00
hnp_contact.c Revise the routed framework to be multi-select so it can support the new conduit system. Update all calls to rml.send* to the new syntax. Define an orte_mgmt_conduit for admin and IOF messages, and an orte_coll_conduit for all collective operations (e.g., xcast, modex, and barrier). 2016-10-23 21:52:39 -07:00
hnp_contact.h Purge whitespace from the repo 2015-06-23 20:59:57 -07:00
listener.c Purge whitespace from the repo 2015-06-23 20:59:57 -07:00
listener.h Purge whitespace from the repo 2015-06-23 20:59:57 -07:00
Makefile.am Compress the xcast message if bigger than a defined size to further improve launch performance at scale 2017-01-19 22:08:02 -08:00
name_fns.c orte_util_snprintf_jobid: return ORTE_SUCCESS or ORTE_ERROR 2016-01-18 09:44:33 +09:00
name_fns.h sentinel: fix sentinel to proc_name conversion 2016-02-10 15:44:07 +09:00
nidmap.c Create an alternative mapping method that pushes responsibility 2017-03-07 20:43:12 -08:00
nidmap.h Create an alternative mapping method that pushes responsibility 2017-03-07 20:43:12 -08:00
parse_options.c Purge whitespace from the repo 2015-06-23 20:59:57 -07:00
parse_options.h Purge whitespace from the repo 2015-06-23 20:59:57 -07:00
pre_condition_transports.c Enable PSM to support dynamic processes 2016-09-02 10:22:04 -07:00
pre_condition_transports.h Purge whitespace from the repo 2015-06-23 20:59:57 -07:00
proc_info.c Clean out old cruft from the ORCM project 2016-09-21 00:13:30 -07:00
proc_info.h hwloc: rename opal/mca/hwloc/hwloc.h -> hwloc-internal.h 2017-02-28 07:48:42 -08:00
regex.c Create an alternative mapping method that pushes responsibility 2017-03-07 20:43:12 -08:00
regex.h Create an alternative mapping method that pushes responsibility 2017-03-07 20:43:12 -08:00
session_dir.c Fix the session directory cleanup - only remove the jobfam session dir level if we are the local daemon and are cleaning up our own session directory. 2016-12-03 09:59:18 -08:00
session_dir.h Several fixes related to session directories: 2016-09-05 07:48:44 +03:00
show_help.c Fix static port and partial allocation operations 2017-01-28 10:09:44 -08:00
show_help.h Purge whitespace from the repo 2015-06-23 20:59:57 -07:00