ports/openmpi
ports/openmpi
1
1
Форкнуть 0
Код Релизы Активность
29 253 коммитов 3 Ветки 0 Теги
Граф коммитов

5818 Коммитов

Автор SHA1 Сообщение Дата
Ralph Castain
9c84e1485b Some minor cleanups of the DVM 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-11-12 16:27:37 -08:00
Boris Karasev
d2a568afa5 rmaps/mindist: reworked the job map binding 
The following issues have been fixed for `mindist`:
- computing the job map on the backend nodes
- using slots count (`-host node1:<s1>,nodeN:<sN>`)
- fixed `dist:span` job mapping method
- fixed `oversubcribe` option with `-host`

Signed-off-by: Boris Karasev <karasev.b@gmail.com>
 2017-11-09 08:56:44 +02:00
Ralph Castain
dcf389b6fa We now add all nodes to the job data object when we map, so don't do it twice 
Fixes #4449

Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-11-05 17:17:50 -08:00
Matt Ezell
e45761d498 Disable the LSF plm if CSM is detected 
LSF running on top of CSM does not provide LSF daemons on the compute nodes.

Signed-off-by: Matt Ezell <ezellma@ornl.gov>
 2017-11-02 13:48:46 -04:00
Ralph Castain
b97caf8f05 Correct copy/paste error in example 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-11-02 10:33:28 -07:00
Ralph Castain
6be74bfa7e Add another test program for cross-lib coordination, this one based on native PMIx commands 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-10-29 11:33:25 -07:00
Ralph Castain
3b71be4db4 Update the scaling script to avoid use of "system" command, thus ensuring that each command sees the same environment. Fix prun to pickup and propagate OMPI MCA params 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-10-23 16:27:41 -07:00
bosilca
ac348da13a Merge pull request #4374 from bosilca/topic/osx_syslog 
Topic/osx syslog
 2017-10-23 18:06:36 -04:00
Ralph Castain
e33f319380 Update example to show tests of various APIs 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-10-23 12:02:54 -07:00
Ralph Castain
6ea3c8a0bd Update the interlib example to show an alternative method for model declaration. Add a missing range value to the OPAL layer. Make it easier to see OMPI model callbacks 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-10-23 11:27:42 -07:00
George Bosilca
8f32b345de
Address syslog issues on OSX 10.13 with gcc 7.x 
gcc 7.[1,2] (at least) fails to correctly parse the OSX 10.13 sys/syslog.h
header. As a results we need to potect syslog support in OPAL, PMIX and
ORTE.

Signed-off-by: George Bosilca <bosilca@icl.utk.edu>
Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
 2017-10-23 14:02:10 -04:00
Ralph Castain
a63904d47f Updates to support cross-version operations with OMPI v2.x 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-10-22 08:38:33 -07:00
Ralph Castain
f8ce31f13c Fix event registration so OpenMP/MPI coordination sides can both get notification of model declarations 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-10-19 18:06:38 -07:00
Ralph Castain
75d411f3ea Ensure we update the routing plan so that tree spawn works! 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-10-19 14:02:06 -07:00
Ralph Castain
6ffb0d0507 Ensure that the pmix server system-level rendezvous file is only output by the HNP as (at least for slurm on cray) a daemon could be colocated with the HNP and overwrite the file. Update the scaling.pl script to only use the system-level rendezvous so it doesn't get rejected by a colocated daemon 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-10-14 10:16:49 -07:00
Ralph Castain
60b338e857 Sync to PMIx v3. Ensure prun uses the ess/tool component. 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-10-14 08:24:57 -07:00
Ralph Castain
388034c814 Add support for the -v (verbose) option to prun and silence the "executing" and "completed" output otherwise. 
Debounce "unreachable" notifications for tools when they disconnect
Enable the -x cmd line option for prun

Signed-off-by: Ralph Castain <rhc@open-mpi.org>
(cherry picked from commit 0a5b36180a22959654461ac1303cec35313f8b4a)
 2017-10-10 12:54:49 -07:00
Ralph Castain
c696e04c5e Since PMIx is moving to release v3.0, embed the new release candidate in opal/pmix framework. Move the pmix2x code over to the ext2x component. Create a new ext3x component 
Remove some build product. Tell PMIx that we don't need a new nspace generated when OMPI calls connect
Add missing Makefile

Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-10-09 13:51:08 -07:00
Ralph Castain
5352c31914 Enable remote tool connections for the DVM. Fix notifications so we "de-bounce" termination calls 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-10-06 10:47:05 -07:00
Ralph Castain
d7d127b9b5 Correctly assign locales when mapping ppr 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-10-03 03:03:56 -07:00
Ralph Castain
7d538c661c Initialize variable and correctly compare against success 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-09-29 16:07:42 -07:00
Ralph Castain
d5ce3c38e1 Begin cleaning up debugger support 
Debugger daemons do not count against available slots. Clean up some leftover errors from the upgrade to HWLOC 2 in the mappers. Properly flag debugger jobs that come in via PMIx.

Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-09-27 16:18:43 -05:00
Ralph Castain
fcb7a2f29b Minor cleanups for when using external pmix 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-09-24 09:53:04 -07:00
Ralph Castain
fe9b584c05 Fully support OMPI spawn options. Fix a bug in the round-robin mappers where we weren't adding nodes to the job map node array, and so resources were not released 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
(cherry picked from commit 285d8cfef74ffc899e9c51e1d9c597b7fb2ceb89)
 2017-09-21 10:29:27 -07:00
Ralph Castain
e575c4d6f9 Fix tool connection logic so we properly search for default session server, perform specified number of retries, etc. 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
(cherry picked from commit 7c755e01004f8b86c71f1729662979ea45ab1adb)
 2017-09-19 13:35:46 -07:00
Ralph Castain
16de607607 Merge pull request #4234 from rhc54/topic/upstream 
Ensure we update the total_slots_alloc field on each job. Correct the client example
 2017-09-19 09:03:04 -07:00
Ralph Castain
658c3d1d51 Ensure we update the total_slots_alloc field on each job. Correct the client example 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
(cherry picked from commit bcedd12a8a24dd246f04ff13b4fd2f1bbac6ce5a)
 2017-09-19 08:14:14 -07:00
Jeff Squyres
7cccee9d92 rmaps/base: remove debugging "DONE" message 
Thanks for Ben Menadue for reporting and supplying the patch.

Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
 2017-09-19 07:10:00 -07:00
Ralph Castain
5708872112 Implement support for "local" range when publishing data 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
(cherry picked from commit 2d54f7e0dd3a47260b0b2634aae3361316005933)
 2017-09-18 19:34:08 -07:00
Ralph Castain
08c93091f7 Merge pull request #4223 from rhc54/topic/stale 
Remove stale tools
 2017-09-18 09:43:06 -07:00
Josh Hursey
252be7ffb0 Merge pull request #4215 from jjhursey/fix/plm-lsf-rc 
plm/lsf: Improve error message if lsb_launch fails
 2017-09-18 11:14:25 -05:00
Ralph Castain
ed508010b4 Remove stale tools 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-09-18 07:30:47 -07:00
Ralph Castain
3c914a7a97 Complete the fix of the ORTE DVM. We will now use "prun" instead of "orterun -hnp foo" to execute jobs. This provides the feature of automatic discovery of the orte-dvm so you don't need to manually enter URI's or contact file locations. All IO is forwarded to prun. 
Still in the "needs to be done" category:

* mapping/ranking/binding options aren't correctly supported

* if the DVM encounters some errors (e.g., not enough resources for the job), the resulting error is globally set and impacts any subsequent job submission

Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-09-16 13:13:07 -07:00
Joshua Hursey
89c1aaf646 plm/lsf: Improve error message if lsb_launch fails 
Signed-off-by: Joshua Hursey <jhursey@us.ibm.com>
 2017-09-15 09:45:58 -05:00
Ralph Castain
7c7d8a69a0 Backport changes from PMIx reference server 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-09-14 11:48:56 -07:00
Ralph Castain
8d336ddcc0 Merge pull request #4209 from rhc54/topic/foobar 
Only build prun if building --with-devel-headers
 2017-09-13 13:07:29 -07:00
Ralph Castain
3f8908871b Since the DVM is now tied to prun, don't build the DVM either unless prun can be built 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-09-13 11:55:10 -07:00
Ralph Castain
589cc03d8e Only build prun if building --with-devel-headers 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-09-13 11:38:11 -07:00
Ralph Castain
0a3d8af4c2 Merge pull request #4202 from anandhis/master 
Choosing provider when user requests generic transport "fabric"
 2017-09-13 11:21:24 -07:00
Ralph Castain
bbd83fd4c0 Add a new launcher "prun" for starting applications against the ORTE DVM. 
Unlike "orterun", "prun" is a PMIx-only program that discovers the DVM connection instead of requiring that we explicitly provide it. Only build "prun" if PMIx v2.x is available.

This gets the DVM working again, but still is showing problems for multiple executions. I'll detail those in a separate issue. Thus, the DVM should still be considered "broken".

Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-09-12 21:40:41 -07:00
anandhi
4d7de8882f Checking for generic transport "fabric" in mca parameter rml_ofi_transports 
to choose the first available non-socket provider.
	modified:   orte/mca/rml/ofi/rml_ofi_component.c
	modified:   orte/mca/rml/ofi/rml_ofi_send.c

Signed-off-by: Anandhi Jayakumar <anandhi.s.jayakumar@intel.com>
 2017-09-12 15:39:55 -07:00
Ralph Castain
3477079804 Repair the ORTE DVM 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-09-11 17:38:21 -07:00
Joshua Hursey
420ca65f4f orte/pmix: Always seed environment with global rank 
* Even if we are only launching one app context, we might call spawn
   later and the remote groups might want their global rank information.

Signed-off-by: Joshua Hursey <jhursey@us.ibm.com>
 2017-09-08 08:53:49 -05:00
Howard Pritchard
5db9416724 rml/ofi: swat a compiler warning 
On the path to -Werror passing builds!

Signed-off-by: Howard Pritchard <howardp@lanl.gov>
 2017-08-30 09:16:49 -06:00
Josh Hursey
ad87aa2674 Merge pull request #4121 from jjhursey/explore/dlopen-local 
mca: Dynamic components link against project lib
 2017-08-25 13:15:51 -05:00
Joshua Hursey
e1d079544b mca: Dynamic components link against project lib 
* Resolves #3705
 * Components should link against the project level library to better
   support `dlopen` with `RTLD_LOCAL`.
 * Extend the `mca_FRAMEWORK_COMPONENT_la_LIBADD` in the `Makefile.am`
   with the appropriate project level library:
```
MCA components in ompi/
       $(top_builddir)/ompi/lib@OMPI_LIBMPI_NAME@.la
MCA components in orte/
       $(top_builddir)/orte/lib@ORTE_LIB_PREFIX@open-rte.la
MCA components in opal/
       $(top_builddir)/opal/lib@OPAL_LIB_PREFIX@open-pal.la
MCA components in oshmem/
       $(top_builddir)/oshmem/liboshmem.la"
```

Note: The changes in this commit were automated by the script in
the commit that proceeds it with the `libadd_mca_comp_update.py`
script. Some components were not included in this change because
they are statically built only.

Signed-off-by: Joshua Hursey <jhursey@us.ibm.com>
 2017-08-24 11:56:16 -04:00
Ralph Castain
68029b27e4 Fix the orte-dvm operations so that orterun can connect and execute an application. There is a lingering problem, though. The first invocation of orterun succeeds every time. However, subsequent invocations have a high probability of hanging in the OOB connection handshake. 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-08-23 17:31:08 -07:00
Ralph Castain
d80b0c7990 If the HWLOC shared memory system is unable to connect, then fallback to providing the topology via XML. Do not automatically provide the XML to every process as that defeats the purpose of the shared memory system. Instead, use PMIx_Query_info_nb to get the info from the server when required. 
Signed-off-by: Ralph Castain <rhc@open-mpi.org>
 2017-08-22 18:12:26 -07:00
Brice Goglin
046d870124 rtc/hwloc/shmem: add Inria copyrights 
The code for finding the hole for the shmem region actually came from me.

Signed-off-by: Brice Goglin <Brice.Goglin@inria.fr>
 2017-08-21 23:09:57 +02:00
Brice Goglin
baf762d99d rtc/hwloc/shmem: dump /proc/self/maps if failed to find a hole and verbosity > 4 
Signed-off-by: Brice Goglin <Brice.Goglin@inria.fr>
 2017-08-21 19:57:38 +02:00