Ralph Castain
d031946c46
When mpirun operates in --continuous mode, we won't terminate the job when a remote process dies. In that case, we have to activate both the waitpid _and_ the IOF complete states to ensure we properly mark the proc as dead and perform any required notifications
...
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
2016-10-25 12:18:14 -07:00
Ralph Castain
227d4d9609
Open the conduits for application procs - we probably can remove all the
...
RML-related frameworks from MPI applications now, but let's wait a bit
to ensure we have cleaned up all the points where messaging might occur.
2016-10-24 16:53:19 -07:00
Ralph Castain
649301a3a2
Revise the routed framework to be multi-select so it can support the new conduit system. Update all calls to rml.send* to the new syntax. Define an orte_mgmt_conduit for admin and IOF messages, and an orte_coll_conduit for all collective operations (e.g., xcast, modex, and barrier).
...
Still not completely done as we need a better way of tracking the routed module being used down in the OOB - e.g., when a peer drops connection, we want to remove that route from all conduits that (a) use the OOB and (b) are routed, but we don't want to remove it from an OFI conduit.
2016-10-23 21:52:39 -07:00
Ralph Castain
df8ac7b747
Properly mark a node as down and decrease the number of daemons so any
...
subsequent grpcomm collectives can correctly operate. Note that only the
direct grpcomm component knows how to deal with down nodes.
2016-10-21 09:53:37 -07:00
Gilles Gouaillardet
1846c2d8ad
plm/rsh: use an alternate port if the ORTE_NODE_PORT attribute is set
2016-10-19 16:18:52 +09:00
Gilles Gouaillardet
40424c9d0f
orte/util/hostfile: add the port=<port> option
...
add the option to pass an alternate port to plm
for example
node0 port=2222
directs the plm (via the ORTE_NODE_PORT) attribute to use
the non default port 2222 (e.g. ssh -p 2222 node0 ...)
2016-10-19 15:04:01 +09:00
Gilles Gouaillardet
73ea87800b
orte/util: add the ORTE_NODE_PORT attribute
...
this can be used to direct the plm component to use an alternate port
(e.g. ssh -p 2222 ...)
2016-10-19 15:04:01 +09:00
Ralph Castain
16540c7422
Properly report failure to launch when someone mis-types the name of the application
...
Fixes #2233
2016-10-18 10:09:30 -07:00
Ralph Castain
7be607582e
ORTE applications need to commit any modex send's prior to calling fence
2016-10-18 09:22:56 -07:00
Ralph Castain
57114a09ae
Pickup the npernode and npersocket options and include them in the job object
2016-10-17 12:26:21 -07:00
Gilles Gouaillardet
bd1b6fe661
rml/oob: add a missing include file
2016-10-16 10:25:00 +09:00
Ralph Castain
6f65d0a173
Repair event notification support. Cleanup the long-suffering "epoll: warning" coming out of libevent whenever a process abnormally terminated.
...
Add changes to test program
Sync to PMIx master
2016-10-13 16:27:39 -07:00
Gilles Gouaillardet
451b9dc467
ess: tear down pmix (if any) before oob
2016-10-13 14:08:02 +09:00
Ralph Castain
fca1556787
Some compilers apparently complain about this, so modify the typedef statements
2016-10-12 08:44:03 -07:00
Ralph Castain
a2919174d0
Bring the RML modifications across. This is the first step in a revamp of the ORTE messaging subsystem to support fabric-based communications during launch and wireup phases. When completed, the grpcomm and plm frameworks will each have their own "conduit" for communication - each conduit corresponds to a particular RML messaging transport. This can be the active OOB-based component, or a provider from within the RML/OFI component. Messages sent down the conduit will flow across the associated transport.
...
Multiple conduits can exist at the same time, and can even point to the same base transport. Each conduit can have its own characteristics (e.g., flow control) based on the info keys provided to the "open_conduit" call. For ease during the transition period, the "legacy" RML interfaces remain as wrappers over the new conduit-based APIs using a default conduit opened during orte_init - this default conduit is tied to the OOB framework so that current behaviors are preserved. Once the transition has been completed, a one-time cleanup will be done to update all RML calls to the new APIs and the "legacy" interfaces will be deleted.
While we are at it: Remove oob/usock component to eliminate the TMPDIR length problem - get all working, including oob_stress
2016-10-11 16:01:02 -07:00
Ralph Castain
5b1484a836
Implement the backend support for process-generated event notification
2016-10-08 09:24:28 -07:00
Gilles Gouaillardet
c92e9a5406
use the new OPAL_HASH_TABLE_FOREACH convenience macro
2016-10-08 16:58:20 +09:00
Ralph Castain
51b2bb1d41
Send show_help out thru stderr
2016-10-07 19:23:52 -07:00
Ralph Castain
e773c17cf3
Put show_help thru the PMIx "log" API. This pushes the show_help output from apps into the pmix thread, thus avoiding conflicts in the RML thread, which should help with thread lock situations.
2016-10-02 16:02:23 -07:00
Gilles Gouaillardet
0931d09afa
ess/singleton: silence a valgrind warning
...
initialize a pointer and keep valgrind happy about it
2016-09-27 15:22:39 +09:00
Gilles Gouaillardet
f9ebba4668
ess/singleton: only realloc() when required in fork_hnp()
2016-09-23 16:35:59 +09:00
rhc54
63ba088d09
Merge pull request #2108 from rhc54/topic/reorder
...
Mucho thanks to Gilles - his patch to reorder the CPPFLAGS solves the…
2016-09-22 11:04:21 -05:00
Ralph Castain
a14ec3bdbc
Mucho thanks to Gilles - his patch to reorder the CPPFLAGS solves the problem of inadvertently picking up hwloc and libevent headers from locations in CPPFLAGS while continuing to build the embedded versions. Also silence a minor warning about an uninitialized var.
2016-09-22 07:39:22 -07:00
Gilles Gouaillardet
c7bf9a0ec9
ess/singleton: fix read on the pipe to spawn'ed orted
...
and close the pipe on both ends when it is no more needed
2016-09-22 14:21:52 +09:00
Ralph Castain
de7b1494d9
Clean out old cruft from the ORCM project
2016-09-21 00:13:30 -07:00
Gilles Gouaillardet
83399adb3f
singleton: "safe" read/write to the pipe between (spawn'ed) orted and singleton
2016-09-20 14:56:58 +09:00
Gilles Gouaillardet
e7ae6975d0
orted: fix spawn in singleton mode
...
in singleton mode, have the spawn'ed orted invoke orte_pre_condition_transports()
and send the transport key back to the singleton
2016-09-20 14:39:22 +09:00
Gilles Gouaillardet
d84ac9bdc5
orted: remove debug
...
remove debug code that was added by mistake in open-mpi/ompi@eae9d31784
2016-09-19 19:15:42 +09:00
Gilles Gouaillardet
eae9d31784
pre_condition_transports: code cleanup
...
replace hard coded "OMPI_MCA_orte_precondition_transports" environment variable name
with macro'ed OPAL_MCA_PREFIX"orte_precondition_transports"
2016-09-19 13:31:47 +09:00
Ralph Castain
e55cc63da9
Remove debug
2016-09-16 07:06:58 -07:00
Ralph Castain
a16b3cc33d
Fix some minor complaints - missing "void" in function parameters
2016-09-15 15:18:42 -07:00
Ralph Castain
6f086189e6
Fix trivial typo
2016-09-15 13:10:55 -07:00
Gregory M. Kurtzer
16794cc260
Updates to support Singularity containers v2.2
2016-09-15 09:52:06 -07:00
Gilles Gouaillardet
11ebf3ab23
ess/singleton: when forking hnp, use the PMIX_NAMESPACE sent by the hnp
...
as the jobid
2016-09-15 13:57:23 +09:00
Gilles Gouaillardet
628c730196
pkgconfig: define the pkgincludedir variable in *.pc files
...
this has been made necesarry with open-mpi/ompi@12e796dcaf
Refs open-mpi/ompi#2069
2016-09-13 09:50:14 +09:00
Gilles Gouaillardet
e84b35217f
oob/tcp: plug a memory leak
...
as reported by Coverity with CID 1196711
2016-09-08 18:50:18 +09:00
Gilles Gouaillardet
b2a2be0e5a
odls: fix memory leak plug
...
This fixes commit open-mpi/ompi@e2c343cdfc .
2016-09-08 10:02:52 +09:00
Jeff Squyres
fd829ac389
Merge pull request #1982 from jsquyres/pr/fix-pkg-config-static
...
pkg-config: fix static linking
2016-09-07 14:55:50 -04:00
Jeff Squyres
b811b0a15c
Merge pull request #2060 from jsquyres/pr/remove-unused-var
...
orte proc_info.c: remove unused variable
2016-09-07 06:33:26 -04:00
Artem Polyakov
9eba1b0b75
Merge pull request #2042 from artpol84/pmix_sdirs
...
Several fixes related to session directories:
2016-09-07 14:15:47 +07:00
Artem Polyakov
a9a7f39773
ess/pmi: fix the comments about MCA/PMIx setting conflict resolution.
2016-09-07 07:47:35 +03:00
Gilles Gouaillardet
be41b120d0
orted: plug misc memory leaks
...
as reported by Coverity with CID 1362603 and 1362606
2016-09-07 10:08:44 +09:00
Gilles Gouaillardet
e2c343cdfc
odls: plus memory leak
...
as reported by Coverity with CID 710645
2016-09-07 10:08:44 +09:00
Gilles Gouaillardet
c09899f6af
plm: plus resource leaks
...
as reported by Coverity with CIDs 72274 and 1196733
2016-09-07 10:08:44 +09:00
Jeff Squyres
722d5eecf1
orte proc_info.c: remove unused variable
...
Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
2016-09-06 16:38:15 -07:00
Josh Hursey
f6337f9eae
Merge pull request #2047 from jjhursey/topic/mixed-host2
...
orte: !FQDN implementation to use opal_net_isaddr
2016-09-06 13:08:54 -05:00
Ralph Castain
f85dcaee2a
Fixes CID 1369067 and CID 1196684
...
Fixes CID 1369648
Fixes CID 1372409
2016-09-06 08:43:15 -07:00
Artem Polyakov
74a11d7832
Fix session dir cleanup code.
2016-09-05 07:53:55 +03:00
Artem Polyakov
dc0ab674de
Add PMIx key to provide RM with ability to indicate that it will cleanup
...
session directories provided at through OPAL_PMIX_TMPDIR,
OPAL_PMIX_NSDIR, OPAL_PMIX_PROCDIR
2016-09-05 07:48:44 +03:00
Artem Polyakov
81195ab724
Several fixes related to session directories:
...
* enable OMPI to retrieve paths from RM through PMIx
* cleanups related to tempdirs.
2016-09-05 07:48:44 +03:00