1
1
Граф коммитов

1111 Коммитов

Автор SHA1 Сообщение Дата
Ralph Castain
a2919174d0 Bring the RML modifications across. This is the first step in a revamp of the ORTE messaging subsystem to support fabric-based communications during launch and wireup phases. When completed, the grpcomm and plm frameworks will each have their own "conduit" for communication - each conduit corresponds to a particular RML messaging transport. This can be the active OOB-based component, or a provider from within the RML/OFI component. Messages sent down the conduit will flow across the associated transport.
Multiple conduits can exist at the same time, and can even point to the same base transport. Each conduit can have its own characteristics (e.g., flow control) based on the info keys provided to the "open_conduit" call. For ease during the transition period, the "legacy" RML interfaces remain as wrappers over the new conduit-based APIs using a default conduit opened during orte_init - this default conduit is tied to the OOB framework so that current behaviors are preserved. Once the transition has been completed, a one-time cleanup will be done to update all RML calls to the new APIs and the "legacy" interfaces will be deleted.

While we are at it: Remove oob/usock component to eliminate the TMPDIR length problem - get all working, including oob_stress
2016-10-11 16:01:02 -07:00
Ralph Castain
5b1484a836 Implement the backend support for process-generated event notification 2016-10-08 09:24:28 -07:00
Joshua Hursey
fc3cf994db build: Custom libmpi_FOO name fix for wrapper compilers
* In open-mpi/ompi@f6f24a4f67 I missed
   updating the library references for the wrapper compilers.
 * Fixes the CXX wrapper compiler and CXX library is renamed as needed.
 * Fixes the Java wrapper compiler and the Java library is renamed as needed.
2016-09-30 16:40:56 -05:00
Ralph Castain
3acbc92efd If everyone is going to start using this script, then let's at least line up the entries 2016-09-27 09:05:05 -07:00
mpiteam
4a4b83b466 Update the nightly tarball script to point to the OMPI master repo 2016-09-20 19:38:01 -07:00
Ralph Castain
9c3ae64297 Merge branch 'master' of https://github.com/open-mpi/ompi 2016-09-16 15:49:34 -05:00
Ralph Castain
408199ce20 Fix a typo in the remove-old script that caused it to ignore all non-directory files, including the tarballs it was meant to delete 2016-09-16 15:48:24 -05:00
Ralph Castain
037020e448 Add the new v2.0.x branch to nightly tarballs 2016-09-14 16:16:26 -07:00
Jeff Squyres
17ca44b25e Merge pull request #1984 from jsquyres/pr/auto-generate-AUTHORS
Be able to auto-generate AUTHORS and preserve org affiliations
2016-08-22 15:37:22 -04:00
Ralph Castain
700ad84243 Send the pmix build results to me 2016-08-20 07:32:06 -07:00
Ralph Castain
c9dc286f25 Update the hwloc coverity submission script 2016-08-19 09:20:48 -07:00
Jeff Squyres
1ba1e9e0b7 make-authors.pl: Auto-generate the entire AUTHORS file
Update the script to auto-generate the entire AUTHORS file from two
sources:

1. The existing AUTHORS file
2. The output from "git log --format=tformat:=tformat:'%aN <%aE>'"

Merge these two together (which will preserve organization
affiliations) and warn in two cases:

1. If a person has no organization affiliation
1. If the same email address appears for more than one person

Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
2016-08-18 07:29:18 -05:00
Ralph Castain
be8424b691 Provide backward compatible keys so that the non-PMIx components in the opal/pmix framework don't have to adjust as we continue to work on finalizing the PMIx reference scheme. Activate and utilize the new PMIx show_help capability to provide more meaningful error output when the server cannot start.
Add a contrib script to cleanup permissions incorrectly modified due to things like smb mounts

dd
2016-08-13 12:13:04 -07:00
Ralph Castain
23886754f0 Trim the coverity build line to packages available on this machine 2016-08-10 13:55:55 -07:00
Ralph Castain
55551a4fb7 Complete debug of the nightly coverity submittal 2016-08-10 12:05:21 -07:00
Ralph Castain
375f04b277 Update the nightly builds to submit to coverity 2016-08-10 08:45:18 -07:00
Ralph Castain
3e17e2fb29 Grrr...silly lists moved to new address! 2016-08-03 21:17:01 -07:00
Ralph Castain
b61eb3a133 Update addresses for nightly build results 2016-08-03 14:25:59 -07:00
Ralph Castain
16cfbf9828 Only post tarballs if something changed 2016-08-02 21:59:18 -07:00
Ralph Castain
9cbe6af9bb Move upload cmds from outside an "if master" test so all versions get uploaded 2016-08-02 20:18:15 -07:00
Ralph Castain
e2d0cfeb3f Shift address to myself pending mailing list update 2016-08-02 20:07:23 -07:00
Jeff Squyres
f619c61366 coverity: update tool download URL
Coverity changes its tool download URL every once in a while; update
our scripts for the newest URL.

Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
2016-08-02 18:54:19 -07:00
Ralph Castain
c4c04f6a2c Cleanup minor typo 2016-07-29 16:20:10 -07:00
Ralph Castain
2c19971048 Send hwloc nightly tarball messages to their mailing list 2016-07-29 15:53:47 -07:00
Ralph Castain
11d4002954 Update the nightly tarball scripts to support the new web site 2016-07-29 15:48:28 -07:00
Jeff Squyres
835657e700 Save Open MPI's gitdub config
README information about gitdub coming soon.

Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
2016-07-29 10:15:53 -04:00
Jeff Squyres
48938f542c openmpi.spec: don't export FFLAGS
The Open MPI configure script has long-since only paid attention to
FCFLAGS.  Indeed, it will warn if you set FFLAGS or F77FLAGS.  So
remove them from the spec file.

Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
2016-07-12 14:22:20 -07:00
Jeff Squyres
95ecae8688 coverity: add --enable-debug to nightly Coverity builds
Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
2016-06-08 08:01:47 -07:00
Alina Sklarevich
a2be17ec14 Revert "mellanox/optimized: set enable_openib_rdmacm_ibaddr=yes in the mellanox/optimized file."
This reverts commit 6cd7282631.
2016-06-06 11:26:11 +03:00
Jeff Squyres
cf27ec36b3 mpirun.zsh: add options to zsh shell completion
Add the following to zsh shell completion:

* --get-stack-traces
* --report-state-upon-timeout
* --timeout

Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
2016-05-31 16:33:46 -07:00
Nathan Hjelm
1e6b4f2f55 Merge pull request #1495 from hjelmn/new_hooks
Add new patcher memory hooks
2016-04-13 18:19:23 -06:00
Nathan Hjelm
27f8a4e806 opal: add code patcher framework
This commit adds a framework to abstract runtime code patching.
Components in the new framework can provide functions for either
patching a named function or a function pointer. The later
functionality is not being used but may provide a way to allow memory
hooks when dlopen functionality is disabled.

This commit adds two different flavors of code patching. The first is
provided by the overwrite component. This component overwrites the
first several instructions of the target function with code to jump to
the provided hook function. The hook is expected to provide the full
functionality of the hooked function.

The linux patcher component is based on the memory hooks in ucx. It
only works on linux and operates by overwriting function pointers in
the symbol table. In this case the hook is free to call the original
function using the function pointer returned by dlsym.

Both components restore the original functions when the patcher
framework closes.

Changes had to be made to support Power/PowerPC with the Linux
dynamic loader patcher. Some of the changes:

 - Move code necessary for powerpc/power support to the patcher
   base. The code is needed by both the overwrite and linux
   components.

 - Move patch structure down to base and move the patch list to
   mca_patcher_base_module_t. The structure has been modified to
   include a function pointer to the function that will unapply the
   patch. This allows the mixing of multiple different types of
   patches in the patch_list.

 - Update linux patching code to keep track of the matching between
   got entry and original (unpatched) address. This allows us to
   completely clean up the patch on finalize.

All patchers keep track of the changes they made so that they can be
reversed when the patcher framework is closed.

At this time there are bugs in the Linux dynamic loader patcher so
its priority is lower than the overwrite patcher.

Signed-off-by: Nathan Hjelm <hjelmn@lanl.gov>
2016-04-13 17:16:13 -06:00
Nathan Hjelm
b1670f844d contrib/platform: don't disable dlopen
The --enable-static gives us what we want: statically linked components.

Signed-off-by: Nathan Hjelm <hjelmn@lanl.gov>
2016-04-13 17:16:12 -06:00
Alina Sklarevich
6cd7282631 mellanox/optimized: set enable_openib_rdmacm_ibaddr=yes in the mellanox/optimized file. 2016-04-11 18:01:16 +03:00
George Bosilca
f69eba1bc4 Update the copyright and cleanup the code.
Per @jsquyres suggestion remove all trailing spaces.
Credit to `sed -i.bak 's/ *$//' */[ch]`.
2016-03-28 14:41:01 -04:00
George Bosilca
32277db6ab Add support for async progress in the BTL TCP.
All BTL-only operations (basically all data movements
with the exception of the matching operation) can now
be handled for the TCP BTL by a progress thread.
2016-03-28 14:40:50 -04:00
Nathan Hjelm
018e3ebeb6 Merge pull request #1471 from hjelmn/lanl_platform
contrib/lanl: update platform files for TOSS2
2016-03-18 15:04:34 -06:00
Ralph Castain
972026b9c1 Add the option to not make the greek tarball, only making the non-greek one 2016-03-18 12:25:20 -07:00
Nathan Hjelm
147e780fa5 contrib/lanl: update platform files for TOSS2
Signed-off-by: Nathan Hjelm <hjelmn@lanl.gov>
2016-03-17 14:30:50 -06:00
Ralph Castain
079ea14dab Update symbol-hiding script 2015-12-21 20:49:14 -08:00
Igor Ivanov
36d3a7aa6c contrib: Add bash script to measure performance
This script is useful to measure times from launching ompi
application to different internal points. A user can easy add
it`s test basing on existing tests.
See readme information inside the script.
2015-12-14 17:42:19 +02:00
Ralph Castain
10db7ebfab Update the symbol-hiding script to capture a broader range of symbols 2015-12-04 21:05:57 -08:00
Jeff Squyres
a549db8ce2 create_tarball.sh: use "autogen.pl --force" 2015-11-20 22:42:01 -05:00
Jeff Squyres
acf94eef7e create_tarball: cleanup whitespace errors
No code / logic changes.
2015-11-20 22:40:23 -05:00
Gilles Gouaillardet
c61ef30980 autogen.pl: aborts if autogen.pl is invoked from an Open MPI tarball and without the --force option
Thanks Jeff for the wording and review
2015-11-20 13:00:55 +09:00
Ralph Castain
84eb21d6bf Update the script to properly run on the Cray. Add rawout option to retain the raw timing output in case the formats don't match 2015-11-12 12:11:17 -08:00
Gilles Gouaillardet
6ab3289582 rpm: fix openmpi.spec not to include the /usr directory
/usr cannot be included on RHEL7 like distros
2015-11-12 16:21:40 +09:00
Ralph Castain
1607daeb10 Update the scaling script to output data into a CSV file for easy import into Excel 2015-11-11 13:29:37 -08:00
Ralph Castain
efbea40a8b Minor typo for slurm scaling test support, add aprun for use on Cray 2015-11-11 13:29:37 -08:00
Ralph Castain
187fa9b131 Extend the scaling test script to support multiple starters, including mpirun, orterun (if mpirun not present), orte-dvm, and srun. Auto-detect which are p
resent and allow the user to run all of them. Auto-detect the number of nodes in the allocation.
2015-11-08 11:34:06 -08:00
Ralph Castain
f2805fb0f9 Provide a mechanism for renaming symbols in the opposite direction - i.e., #define prefix_foo[suffix] foo. 2015-11-07 18:07:09 -08:00
Ralph Castain
73c8c30c5d Update the scaling.pl test script to support orte-dvm and srun 2015-11-07 13:13:36 -08:00
Ralph Castain
1f44fef4d6 Add ability to provide a suffix to the symbol renames 2015-11-07 12:37:14 -08:00
Ralph Castain
6864a9b68a Add a new script for creating symbol hiding "rename" files 2015-11-07 12:11:54 -08:00
Ralph Castain
18c5cb48ff Update the scaling test script 2015-11-06 21:51:40 -08:00
Mike Dubman
cdffe4f92d BUILD: update mellanox platform file
add support for UCX
2015-10-21 11:39:30 +03:00
Howard Pritchard
89b9be3732 lanl/platform: fixes to pick up lustre
Fixes to lanl platform files to pick up lustre header
files, etc. for romio and ompi i/o.

Fixes #1033

Thanks to Jerome Vienne for spotting this.

Signed-off-by: Howard Pritchard <howardp@lanl.gov>
2015-10-15 14:32:21 -05:00
Ralph Castain
c1bbbb5e2f Remove the last involvement of the OOB system from the MPI layer, remove the no-longer-needed usock/oob component, and have procs no longer open the RML, OOB, ROUTED, and GRPCOMM frameworks as PMIx now provides all required app-mpirun cmds 2015-09-15 13:08:35 -07:00
Jeff Squyres
12367d8444 whitespace-purge: switch from sed to perl
The perl form is more portable.
2015-09-08 09:36:36 -07:00
Nathan Hjelm
b4fcd3897e Simplify whitespace purge script a little.
Do not need to test with -f. If directories ever show up in git
ls-files (unlikely) their mime type is application/x-directory which
will fail the test ${file::4} == text check.

Signed-off-by: Nathan Hjelm <hjelmn@lanl.gov>
2015-08-24 09:30:46 -06:00
Nathan Hjelm
92ec9ca2bb update whitespace purge script to skip all non-text files
Signed-off-by: Nathan Hjelm <hjelmn@lanl.gov>
2015-08-24 09:24:37 -06:00
Jeff Squyres
7217f37092 nightly tarball: only save 7 days worth of nightly build trees
This should help alleviate running out of disk space on the IU build
server.
2015-08-22 03:19:44 -07:00
Ralph Castain
d1ac247e0d Update whitespace-purge script 2015-08-19 12:09:42 -07:00
Jeff Squyres
98b5551126 openmpi-nightly-tarball: update libfabric install location 2015-08-05 17:57:07 -04:00
Howard Pritchard
d4eb5addb0 contrib/lanl: update Makefile
Signed-off-by: Howard Pritchard <howardp@lanl.gov>
2015-07-31 14:38:48 -07:00
Howard Pritchard
13bfb2baab Merge pull request #744 from hppritcha/topic/help_lanl_admins
lanl: help out lanl admins
2015-07-24 11:48:17 -06:00
Howard Pritchard
5eccba17af lanl: help out lanl admins
LANL admins want platform files and *.conf
files so oblige them.

Signed-off-by: Howard Pritchard <howardp@lanl.gov>
2015-07-24 08:03:52 -07:00
Jeff Squyres
ac547126ca openmpi-nightly-tarball.sh: more verbosity, fix coverity
Add --with-libfabric CLI argument to the coverity build so that usnic
support can be built.
2015-07-22 21:44:10 -04:00
Jeff Squyres
162da0e98d authors-to-cvsimport.pl: remove stale file
This script isn't needed any more.
2015-07-22 21:43:25 -04:00
Ralph Castain
67769d4a59 Update search_compare script 2015-07-17 17:36:37 -07:00
Jeff Squyres
cce57da0c4 openmpi-update-hg-svn.h: remove stale file
This file accidentaly got left over when we switched from SVN to git.
2015-07-02 12:17:02 -04:00
MPI Team
34f7e30158 openmpi-nightly-tarball: fix typo
The branch name is "v2.x", not "2.x".
2015-06-29 17:04:06 -04:00
Ralph Castain
75ceec663a Now that it has been officially released, update the embedded HWLOC to 1.11.0 2015-06-28 14:07:45 -07:00
Ralph Castain
265cd14f60 Purge whitespace 2015-06-25 13:27:56 -07:00
Ralph Castain
24cc9358a6 Set the whitespace-purge.sh script to be executable 2015-06-24 08:29:26 -07:00
Ralph Castain
869041f770 Purge whitespace from the repo 2015-06-23 20:59:57 -07:00
Jeff Squyres
74cf969561 openmpi-nightly-tarball.sh: now build 2.x nightlies 2015-06-22 06:17:56 -04:00
Jeff Squyres
e9b59d8484 make_dist_tarball: don't make "o" writable
We only need "ug" writable (so that we can delete stuff at the end).
No need to make "o" writable.
2015-06-19 12:26:12 -07:00
Jeff Squyres
3ad89f16b8 openmpi-release.sh: haven't used "sowing" in years 2015-06-19 12:26:12 -07:00
Jeff Squyres
7b9e349498 iopenmpi-nightly-tarball.sh: make v1.10 tarballs 2015-05-27 11:45:40 -07:00
MPI Team
6dce955e55 update github wiki script: remove debugging comment 2015-05-13 19:05:01 -04:00
Jeff Squyres
bd0a4f0f8b Script to update Github wiki ComponentOwners page
First cut.
2015-05-13 18:58:02 -04:00
Jeff Squyres
ccfee0cd2d check-owner.pl: fix comments 2015-05-13 18:31:12 -04:00
Ralph Castain
9a70765f27 Silence malloc(0) warnings reported by Lisandro 2015-05-12 12:38:58 -07:00
Jeff Squyres
9d9cdbb330 make_dist_tarball: re-enable executable bit
It looks like 0acdf34044 accidentally
removed the executable bits from this file.
2015-05-02 02:19:00 -07:00
Mike Dubman
dede6fa1fb build: new options
- enable/disable know for threads support
- disable rpath by default
2015-04-30 14:46:15 +03:00
Rolf vandeVaart
7163c41a4d Fix pathname 2015-04-08 08:52:17 -04:00
Jeff Squyres
3b998781df make_dist_tarball: bump up the minimum versions 2015-04-01 15:05:48 -07:00
Jeff Squyres
f61d1db1b3 openmpi-nightly-coverity.pl: bring updates from PMIx
We just enabled Coverity builds for the PMIx project; bring over the
improvements from the PMIx nightly coverity script to this script.
2015-03-26 11:19:14 -04:00
Jeff Squyres
914880a368 libtldl: remove libltdl from the tree
The libltdl interface has been completely replaced by the OPAL DL
framework (i.e., the opal_dl interface).

Fixes open-mpi/ompi#311
2015-03-09 08:18:14 -07:00
Howard Pritchard
c124707549 contrib:simple perl script for digesting owner files
Simple perl script for processing owner files into markdown
tables for the open mpi wiki.  Get fancy with later versions.

Signed-off-by: Howard Pritchard <howardp@lanl.gov>
2015-03-06 14:39:02 -07:00
Ralph Castain
07587892da Update search_compare as we no longer support svn - only repo we support is git 2015-03-05 08:25:27 -08:00
Jeff Squyres
4872b0fc28 openmpi-nightly-tarball: move the OMPI token file
Also put the coverity params up top, with all other params.
2015-02-19 09:24:36 -05:00
Jeff Squyres
4e318c9df1 coverity: Coverity updated the project name OpenMPI -> Open MPI
Therefore, we must update the URLs the match the "new" project name. :-)
2015-02-16 10:12:54 -05:00
Jeff Squyres
7d3708d3b8 openmpi-nightly-coverity: ensure the argument is defined 2015-02-15 07:25:53 -05:00
Jeff Squyres
b207736170 openmpi-nightly-coverity: use far simpler version of safe_system()
The previous safe_system() is quite thorough, but much more than we
really need in this script.  Use a far simpler version that is
significantly easier to maintain.

Also log some of the critical steps that a human can examine the
output upon a failure (e.g., when the failure happens when launched
via cron).

Finally, set the version number to not include "openmpi-", because
Coverity has a limited-width display of the version number.
2015-02-14 10:12:51 -05:00
Jeff Squyres
dfd21e465d openmpi-nightly-tarball.sh: only coverity analyze master (for now) 2015-02-14 08:39:55 -05:00
Jeff Squyres
2ce422ceed openmpi-nightly-tarball.sh: go to "verbose" instead of "debug"
Now that the Coverity submit seems to be working, dial back the
cron-generated output to "verbose" instead of "debug".
2015-02-13 11:08:45 -05:00
Jeff Squyres
d2261fa9c6 coverity: move script to build-server directory
Move the openmpi-nightly-coverity.pl script into the directory where
all the other build server scripts live.

Leave the coverity-model.c file in the coverity dir, because it's
specific to coverity.  Other items can be added into the
coverity-model.c, if helpful (and then we can re-submit that model
file).
2015-02-13 11:07:11 -05:00
Jeff Squyres
4fdea4617c nightly tarballs: update coverity CLI params
Ensure to build support for:

* usnic
* PSM
* MXM
* OSHMEM
* Fortran (MPI and OSHMEM)
* Java (MPI and OSHMEM)

So that the OMPI code for all of these networks can be analyzed by
Coverity.

build moar stuff -- squashme
2015-02-13 09:31:49 -05:00