Ralph Castain
04304c186f
Remove the setup_hadoop configure script as it is no longer required - the hadoop support components can build without accessing hadoop itself.
...
This commit was SVN r27385.
2012-09-29 18:30:35 +00:00
Ralph Castain
9daaa001d9
Remove tools that are no longer required
...
This commit was SVN r27383.
2012-09-29 17:33:16 +00:00
Ralph Castain
1ddb334a52
Put the specified JDK path first so we find that one
...
This commit was SVN r27360.
2012-09-22 19:08:52 +00:00
Ralph Castain
9057e84ec1
Correct test statement
...
This commit was SVN r27321.
2012-09-12 14:30:03 +00:00
Ralph Castain
876d78f36a
If JAVA_HOME is present on a Linux system, use it to find Java support
...
This commit was SVN r27255.
2012-09-07 00:41:14 +00:00
Nathan Hjelm
0061ac066b
orte/alps: add support for --with-alps=yes on CLE 5.0 and clean out tabs
...
This commit was SVN r27096.
2012-08-20 15:26:58 +00:00
Ralph Castain
b2cd2b1289
Allow developers to enable OMPI progress threads for debugging purposes. Warn and error out if ORTE progress threads are enabled, but they forgot to enable the libevent thread support.
...
This commit was SVN r27071.
2012-08-16 17:50:52 +00:00
Ralph Castain
481ed4e292
Only one equal sign, if you please...
...
This commit was SVN r27037.
2012-08-14 22:08:19 +00:00
Ralph Castain
8c890b1c46
Fix the alps configury so it doesn't attempt to build alps by default, even if --with-alps wasn't given.
...
This commit was SVN r27036.
2012-08-14 22:04:39 +00:00
Nathan Hjelm
d5824f7800
add missing test
...
This commit was SVN r27028.
2012-08-14 03:14:07 +00:00
Nathan Hjelm
3d03d8f08b
fix typo in orte_check_alps.m4
...
This commit was SVN r27027.
2012-08-13 23:00:06 +00:00
Nathan Hjelm
8e03f77004
update alps configure scripts
...
This commit was SVN r27026.
2012-08-13 22:57:55 +00:00
Ralph Castain
8bebf2fa47
Ensure we don't build the MR iof components unless hadoop support is enabled
...
This commit was SVN r26694.
2012-06-28 18:20:15 +00:00
Ralph Castain
96c778656a
Improve launch performance on clusters that use dedicated nodes by instructing the orteds to use the same port as the HNP, thus allowing them to "rollup" their initial callback via the routed network. This substantially reduces the HNP bottleneck and the number of ports opened by the HNP.
...
Restore enable-static-ports option by default - the Cray will have to disable it to get around their library issues, but that's just a warning problem as opposed to blocking the build.
This commit was SVN r26606.
2012-06-15 10:15:07 +00:00
Ralph Castain
cee5a75d19
Revert the default configuration to no orte progress thread and no libevent thread support until we can get more of the kinks ironed out.
...
This commit was SVN r26593.
2012-06-11 20:52:28 +00:00
Ralph Castain
5876496f4c
Enable orte progress threads and libevent thread support by default
...
This commit was SVN r26565.
2012-06-07 04:25:00 +00:00
Ralph Castain
31beff6362
Oops - if we don't want the Java bindings, then we really shouldn't be building them :-/
...
Also ensure we don't try to build them if no Java support was found, and error out if the user requests the bindings and we didn't find Java support.
Add a configure flag to skip the Java tests and just force-set the Java support to "disabled"
This commit was SVN r26484.
2012-05-23 19:51:27 +00:00
Ralph Castain
da3873af6f
Rename the mapreduce tool to "mr+" per the marketing types
...
This commit was SVN r26463.
2012-05-21 21:17:44 +00:00
Nathan Hjelm
6eeca66475
add an option to enable static ports. diabled by default
...
This commit was SVN r26462.
2012-05-21 19:56:15 +00:00
Ralph Castain
83d69b6c95
Enable the ORTE progress thread for apps (not needed in the tools as they already continuously loop in the event lib). This appears to be working, at least for MPI apps that only use shared memory (a simple "hello"). More testing is required to identify where problems will occur - this is only intended to allow further development.
...
In order to use the progress thread, you must configure with:
--enable-orte-progress-threads --enable-event-thread-support
This commit was SVN r26457.
2012-05-20 15:14:43 +00:00
Ralph Castain
ca1b325738
Tweak the java setup so it works better on Mac. Only build mapreduce and allocators if hadoop support was requested.
...
This commit was SVN r26448.
2012-05-18 01:02:01 +00:00
Ralph Castain
b9d560263f
Ensure we properly handle systems that do not have a jdk installed
...
This commit was SVN r26421.
2012-05-10 12:06:59 +00:00
Ralph Castain
b143633593
Fix java config
...
This commit was SVN r26420.
2012-05-10 01:51:02 +00:00
Ralph Castain
fd796cce0a
Add an allocator tool for finding HDFS file locations and obtaining allocations for those nodes (supports both Hadoop 1 and 2). Split the Java support into two parts: detection of Java support and request for Java bindings.
...
This commit was SVN r26414.
2012-05-09 01:13:49 +00:00
Ralph Castain
b2f77bf08f
Extend the iof by adding two new components to support map-reduce IO chaining. Add a mapreduce tool for running such applications.
...
Fix the state machine to support multiple jobs being simultaneously launched as this is not only required for mapreduce, but can happen under comm-spawn applications as well.
This commit was SVN r26380.
2012-05-02 21:00:22 +00:00
Ralph Castain
bd8b4f7f1e
Sorry for mid-day commit, but I had promised on the call to do this upon my return.
...
Roll in the ORTE state machine. Remove last traces of opal_sos. Remove UTK epoch code.
Please see the various emails about the state machine change for details. I'll send something out later with more info on the new arch.
This commit was SVN r26242.
2012-04-06 14:23:13 +00:00
Jeff Squyres
765de087ef
Remove the use of == as a "test" shell operator. Thanks to Paul
...
Hargrove for noticing the issue.
This commit was SVN r25964.
2012-02-20 13:29:04 +00:00
Ralph Castain
a0edae52f2
Ensure the wrapper flags get entered in the right order, with -lpmi coming before the alps util libs
...
This commit was SVN r25809.
2012-01-27 20:56:21 +00:00
Ralph Castain
d643882f89
Cleanup the alps configure logic so we only add the pmi support libs once
...
This commit was SVN r25747.
2012-01-19 22:10:03 +00:00
Ralph Castain
12d163293b
Yeah, I know it's the middle of the afternoon. I'm bound to forget and commit this in with something else if I don't. Per request from LANL, if PMI support is requested on an ALPS machine, add a couple of libs in the right ordering so that static builds will work correctly.
...
This commit was SVN r25732.
2012-01-17 20:41:50 +00:00
Ralph Castain
b475421c16
As promised, rationalize the rsh support. Remove rshbase and the base rsh support, centralizing all rsh support into the rsh component. Remove the "slave" launch support as that experiment is complete. Fix tree spawn and make that the default method for rsh launch, turning it "off" for qrsh as that system does not support tree spawn.
...
This commit was SVN r25507.
2011-11-26 02:33:05 +00:00
Ralph Castain
9b59d8de6f
This is actually a much smaller commit than it appears at first glance - it just touches a lot of files. The --without-rte-support configuration option has never really been implemented completely. The option caused various objects not to be defined and conditionally compiled some base functions, but did nothing to prevent build of the component libraries. Unfortunately, since many of those components use objects covered by the option, it caused builds to break if those components were allowed to build.
...
Brian dealt with this in the past by creating platform files and using "no-build" to block the components. This was clunky, but acceptable when only one organization was using that option. However, that number has now expanded to at least two more locations.
Accordingly, make --without-rte-support actually work by adding appropriate configury to prevent components from building when they shouldn't. While doing so, remove two frameworks (db and rmcast) that are no longer used as ORCM comes to a close (besides, they belonged in ORCM now anyway). Do some minor cleanups along the way.
This commit was SVN r25497.
2011-11-22 21:24:35 +00:00
Samuel Gutierrez
27b9bcfafd
update ess alps configuration file to include CNOS and PMI checks. some of the features committed here aren't being used, but they will be. also update orte_check_pmi.m4 to include missing call to action-if-not-found if --with-pmi is not specified or is disabled.
...
This commit was SVN r25422.
2011-11-03 02:14:47 +00:00
Ralph Castain
3e72fccacf
Cray's PMI implementation is quite different from slurm's - they extended PMI-1 by adding some, but not all, of the PMI-2 APIs. So you can't just switch to using PMI-2 functions as it isn't a complete implementation. Instead, you have to selectively figure out which ones they have in PMI-2, and use any missing ones from PMI-1. What fun.
...
Modify the configure logic and the PMI components to accommodate Cray's approach. Refactor the PMI error reporting code so it resides in only one place. Cray actually decided -not- to define the PMI-2 error codes, so we have to use the PMI-1 codes instead. More fun.
This commit was SVN r25348.
2011-10-21 04:54:38 +00:00
Ralph Castain
8f0ef54130
Complete implementation of pmi support. Ensure we support both mpirun and direct launch within same configuration to avoid requiring separate builds. Add support for generic pmi, not just under slurm. Add publish/subscribe support, although slurm's pmi implementation will just return an error as it hasn't been done yet.
...
This commit was SVN r25303.
2011-10-17 20:51:22 +00:00
Ralph Castain
b96ef2161d
Complete the PMI support. Generalize PMI operations to support both slurm and non-slurm environments. Correct some configuration issues - we really only want the PMI integration at the individual component level. Ensure that the pmi grpcomm component doesn't get selected when launching via mpirun by setting its priority below the bad component.
...
Only verified in a slurm environment as that's all I have access to...
This commit was SVN r25275.
2011-10-12 20:59:25 +00:00
Ralph Castain
1aa1c2e9b4
Get the slurm pmi support working. Cannot use infiniband, of course, as the oob can't make the connection - may try other existing methods. Modex may not quite be working right yet
...
as odin was having trouble making TCP connections, but at least the configure now works so things build, so save that for now
This commit was SVN r25247.
2011-10-10 21:39:10 +00:00
Nathan Hjelm
79b14fc3b1
removed licensing warning
...
This commit was SVN r25235.
2011-10-05 20:31:27 +00:00
Nathan Hjelm
34afb5a0fa
first cut at general pmi check
...
This commit was SVN r25234.
2011-10-05 17:14:24 +00:00
Ralph Castain
56ebfa23cc
ORTE configure options belong in orte/config, not opal.
...
This commit was SVN r25100.
2011-08-27 14:23:49 +00:00
Ralph Castain
92a65f21bf
Restore slurm pmi support from long, long ago. Since we already have the ability to directly srun an MPI job, just conditionally add the PMI support for key values and provide a grpcomm module that uses PMI for barriers and modex.
...
Currently ompi_ignored, and unignored only for me (others to soon follow).
This commit was SVN r24792.
2011-06-20 21:04:46 +00:00
Ralph Castain
d563e58348
Remove another lingering bproc reference
...
This commit was SVN r24785.
2011-06-17 18:01:23 +00:00
Ralph Castain
8c08ee9c3d
Remove stale tool
...
This commit was SVN r24720.
2011-05-21 00:38:35 +00:00
Nysal Jan
c8c6b0edab
Improve LoadLeveler integration with Open MPI. Add support for LL native rsh agent - llspawn
...
This commit was SVN r24579.
2011-03-29 07:46:59 +00:00
Jeff Squyres
e4744b4ed5
Per http://www.open-mpi.org/community/lists/devel/2010/11/8671.php ,
...
change a bunch of OMPI_<foo> names to OPAL_<foo>.
This commit was SVN r24046.
2010-11-12 23:22:11 +00:00
Brian Barrett
9febaa475e
* Add shell of functionality required for supporting Portals4
...
* Update places where orte-free builds have failed
This commit was SVN r23891.
2010-10-14 22:49:09 +00:00
Ralph Castain
162734731d
Sigh - fix one more place where r23764 had a problem
...
This commit was SVN r23816.
The following SVN revision numbers were found above:
r23764 --> open-mpi/ompi@40a2bfa238
2010-09-29 20:47:52 +00:00
Ralph Castain
40a2bfa238
WARNING: Work on the temp branch being merged here encountered problems with bugs in subversion. Considerable effort has gone into validating the branch. However, not all conditions can be checked, so users are cautioned that it may be advisable to not update from the trunk for a few days to allow MTT to identify platform-specific issues.
...
This merges the branch containing the revamped build system based around converting autogen from a bash script to a Perl program. Jeff has provided emails explaining the features contained in the change.
Please note that configure requirements on components HAVE CHANGED. For example. a configure.params file is no longer required in each component directory. See Jeff's emails for an explanation.
This commit was SVN r23764.
2010-09-17 23:04:06 +00:00
Rolf vandeVaart
14e7bcc383
Create new entries in the wrapper data files so the
...
administrator can specify compiler flags that get
inserted into the command before the user's flags.
These flags can be specified at configure time.
Reviewed by Jeff Squyres.
This fixes ticket #2474 .
This commit was SVN r23709.
2010-09-02 10:47:55 +00:00
Rolf vandeVaart
07604d74b8
We were incorrectly handling some of the --with-wrapper-XXX
...
variables resulting in the same flag being installed
twice for the OMPI wrappers.
This fixes trac:2539.
This commit was SVN r23630.
The following Trac tickets were found above:
Ticket 2539 --> https://svn.open-mpi.org/trac/ompi/ticket/2539
2010-08-20 18:01:43 +00:00