ports/openmpi
ports/openmpi
1
1
Форкнуть 0
Код Релизы Активность
17 675 коммитов 3 Ветки 0 Теги 130 MiB
43f883cb42
Граф коммитов

3783 Коммитов

Автор SHA1 Сообщение Дата
Ralph Castain
38ce23db43 Add some protection to allow NULL bytes in byte objects and NULL strings to be handled cleanly in nidmaps and modex entries. Ensure there is a valid nidmap available for the HNP to pass down to any local procs when it is operating alone. 
This commit was SVN r27188.
 2012-08-31 01:07:36 +00:00
Ralph Castain
efc4a40c8a It is okay for a key not to be found 
This commit was SVN r27187.
 2012-08-30 15:12:23 +00:00
Ralph Castain
6dbb7a8493 Just because a peer didn't post a particular pmi key, that doesn't mean it is an immediate irrecoverable error - could be they just don't have a matching interface. Let the upper layer decide what to do about it. 
This commit was SVN r27186.
 2012-08-30 14:12:09 +00:00
Ralph Castain
05c0464dcb Add missing protections 
This commit was SVN r27183.
 2012-08-30 12:17:29 +00:00
Ralph Castain
1b659de132 Get staged execution working on multi-node setups. Improve efficiency by only remapping if all procs not yet mapped in the job. 
This commit was SVN r27181.
 2012-08-29 20:35:52 +00:00
Ralph Castain
a3b08f5800 Fix a few things relating to comm_spawn that causes new daemons to be launched. Ensure that all new daemons receive a full pidmap. Properly mark the daemon job as "updated" when daemons are added 
This commit was SVN r27177.
 2012-08-29 03:11:37 +00:00
Ralph Castain
f0077820f2 Silence warning 
This commit was SVN r27175.
 2012-08-28 22:27:41 +00:00
Ralph Castain
a414ffdf4c Remove debug 
This commit was SVN r27174.
 2012-08-28 22:18:00 +00:00
Ralph Castain
30fd9d7abc MPI procs should definitely not be trapping SIGCHLD - only ORTE tools need to do so 
This commit was SVN r27166.
 2012-08-28 21:39:06 +00:00
Ralph Castain
98580c117b Introduce staged execution. If you don't have adequate resources to run everything without oversubscribing, don't want to oversubscribe, and aren't using MPI, then staged execution lets you (a) run as many procs as there are available resources, and (b) start additional procs as others complete and free up resources. Adds a new mapper as well as a new state machine. 
Remove some stale configure.m4's we no longer need.

Optimize the nidmaps a bit by only sending info that has changed each time, instead of sending a complete copy of everything. Makes no difference for the typical MPI job - only impacts things like staged execution where we are sending multiple (possibly many) launch messages.

This commit was SVN r27165.
 2012-08-28 21:20:17 +00:00
Ralph Castain
aadfe1b61e Fix a missing test that breaks novm operation. 
CMR:v1.7

This commit was SVN r27163.
 2012-08-28 21:13:57 +00:00
Ralph Castain
d310dd8c58 Fix a strange race condition by creating a separate buffer for each send - apparently, just a retain isn't enough protection on some systems 
This commit was SVN r27161.
 2012-08-28 17:17:34 +00:00
Ralph Castain
11c68e2299 Correct the count in the pmi key 
This commit was SVN r27156.
 2012-08-28 15:05:02 +00:00
Ralph Castain
6e8c97c77c Per Sam's eagle-eyed review, free the malloc'd memory if getcwd fails for some strange reason. 
This commit was SVN r27150.
 2012-08-27 19:15:16 +00:00
Ralph Castain
bccc20d13e Deal with one last corner case of positioning a dot-file 
This commit was SVN r27144.
 2012-08-26 03:49:31 +00:00
Ralph Castain
63d41c643d Minor cleanup 
This commit was SVN r27143.
 2012-08-25 14:24:45 +00:00
Ralph Castain
0e1dbe8711 Remove non-existent files 
This commit was SVN r27136.
 2012-08-25 01:29:17 +00:00
Ralph Castain
05f0b4c653 Couple of minor cleanups 
This commit was SVN r27135.
 2012-08-24 21:14:40 +00:00
Ralph Castain
d6cbff6d4e Since the preload flags are at the app_context level, we need to link only those files/exe's that pertain to each app_context to the corresponding procs. Also, gain a little optimization by checking to ensure we only send files once - this probably won't work when daemons are created on-the-fly, but that's for some other day 
This commit was SVN r27134.
 2012-08-24 16:16:30 +00:00
Jeff Squyres
20612c4194 Don't close the IOF stdin if we happen to read less than a full 
buffer's worth of data -- interactive stdin will have that behavior
frequently. 

This commit was SVN r27131.
 2012-08-24 14:29:19 +00:00
Ralph Castain
e0c39c94e8 Complete the cleanup of the preload files system. Remove the dest_dir option as moving things to arbitrary locations - especially absolute paths - can prove disastrous. Remove the preload_libs option as these can be treated as just files. Cleanup some of the pack/unpack code as the dss handles NULL strings just fine. Deal a little better with absolute paths, noting that tar now strips the leading '/' for us (showing my age as it didn't used to do so). 
Remove the odls_base_state.c file as that code is now covered by the new broadcast form of preload_files.

This commit was SVN r27127.
 2012-08-24 02:28:29 +00:00
Ralph Castain
c8b511d18a Remove stale tests 
This commit was SVN r27126.
 2012-08-24 02:22:11 +00:00
Ralph Castain
b4a544ad2a Per discussion with Josh, use the --preload-xxx cmd line options to broadcast files to all nodes. Add --set-cwd-to-session-dir option to start procs in their session directories. Add OMPI_FILE_LOCATION envar to tell procs where their prepositioned files went. 
This commit was SVN r27125.
 2012-08-23 21:28:05 +00:00
Ralph Castain
855c9ae6cf Support archives .tar, .bz[2,zip], and .gz[ip] 
This commit was SVN r27123.
 2012-08-23 15:38:39 +00:00
Ralph Castain
286c610712 Protect us against the scenario where filem is included in enable-mca-no-build 
This commit was SVN r27122.
 2012-08-23 13:52:06 +00:00
Shiqing Fan
d141d94bd7 Include the new .windows files into the tarball. 
This commit was SVN r27121.
 2012-08-23 12:50:51 +00:00
Ralph Castain
7237a938bf Extend the filem interface to support prepositioning and linking required local files for execution. Create a new "raw" module that uses xcast to send the files to all nodes as this is faster than doing an scp in a linear pattern 
This commit was SVN r27118.
 2012-08-22 21:43:20 +00:00
Ralph Castain
ed4b354846 Ensure we pass along user-specified mca params from the cmd line when doing a tree spawn, but don't extend the cmd line with duplicates or things that shouldn't be there 
This commit was SVN r27117.
 2012-08-22 21:41:50 +00:00
Ralph Castain
5d7872fd68 Cleanup the tag list 
This commit was SVN r27115.
 2012-08-22 21:37:58 +00:00
Ralph Castain
3c13176aa7 Remove test code 
This commit was SVN r27114.
 2012-08-22 21:36:54 +00:00
Ralph Castain
7bcf2f8b5c Stop leaving droppings behind us 
This commit was SVN r27111.
 2012-08-22 17:39:22 +00:00
Shiqing Fan
95b9552546 include several components for Windows build. 
This commit was SVN r27108.
 2012-08-22 14:46:49 +00:00
Jeff Squyres
c8cee23ee7 Priorities really shouldn't be less than 0. 
This commit was SVN r27098.
 2012-08-21 15:47:15 +00:00
Ralph Castain
dacb07000d Turn udcm and ud oob off by default, but allow them to build and be used if someone wants to test them 
cmr:v1.7

This commit was SVN r27097.
 2012-08-21 15:18:34 +00:00
Nathan Hjelm
0061ac066b orte/alps: add support for --with-alps=yes on CLE 5.0 and clean out tabs 
This commit was SVN r27096.
 2012-08-20 15:26:58 +00:00
Ralph Castain
64cf75cec5 Add some debug 
This commit was SVN r27087.
 2012-08-17 02:19:26 +00:00
Ralph Castain
a572b6fa9f Pick the right place 
This commit was SVN r27085.
 2012-08-17 00:28:28 +00:00
Ralph Castain
b2cd2b1289 Allow developers to enable OMPI progress threads for debugging purposes. Warn and error out if ORTE progress threads are enabled, but they forgot to enable the libevent thread support. 
This commit was SVN r27071.
 2012-08-16 17:50:52 +00:00
Ralph Castain
335c0eafcf Add a filem test program and set ignores 
This commit was SVN r27069.
 2012-08-16 17:46:46 +00:00
Jeff Squyres
96f640a762 Add new "opal_hotel" class. Abstractly speaking, this class does the 
following:

 * Provides a fixed number of resource slots (i.e., "hotel rooms").
 * Allows one thing to occupy a resource slot at a time (i.e., each
   hotel room can have an occupant check in to that room).
 * Resource slots can be vacated at any time (i.e., occupants can
   voluntarily check out of their hotel room).
 * Resource slots can be occupied for a specific maximum amount of
   time.  If that time expires, the occupant is forcibly evicted and
   the upper layer is notified via (libevent) callback (i.e., the maid
   will kick an occupant of out of their room when their reservation
   is over).

This class can be to be used for things like retransmission schemes
for unreliable transports.  For example, a message sent on an
unreliable transport can be checked in to a hotel room.  If an ACK for
that message is received, the message can be checked out.  But if the
ACK is never received, the message will eventually be evicted from its
room and the upper layer will be notified that the message failed to
check out in time (i.e., that an ACK for that message was not received
in time).

Code using this class is currently being developed off-trunk, but will
be coming to SVN soon.

This commit was SVN r27067.
 2012-08-16 17:29:55 +00:00
Ralph Castain
e4d82b8912 Turn off the common port by default by now until we get rollup working properly on ALL platforms 
This commit was SVN r27060.
 2012-08-15 22:13:04 +00:00
Ralph Castain
35fef87202 Make the "no virtual machine" selection more intuitive by providing a --novm option to mpirun. 
This commit was SVN r27048.
 2012-08-15 14:55:03 +00:00
Ralph Castain
229e3f9b2a This will break systems like orcm, but we aren't trying to support those any more - so put the nodes back in their daemon-indexed position. Will continue working to reduce search requirements in other parts of the code 
This commit was SVN r27038.
 2012-08-14 22:26:40 +00:00
Ralph Castain
481ed4e292 Only one equal sign, if you please... 
This commit was SVN r27037.
 2012-08-14 22:08:19 +00:00
Ralph Castain
8c890b1c46 Fix the alps configury so it doesn't attempt to build alps by default, even if --with-alps wasn't given. 
This commit was SVN r27036.
 2012-08-14 22:04:39 +00:00
Ralph Castain
3cb8d55c8b We can't just lookup the node in the node pool by daemon vpid as the daemons aren't stored that way - this was done because when holes exist in daemon vpids, we can generate huge orte_node_pool arrays even when only a few daemons actually exist. So we have to search for the vpid in the array 
This commit was SVN r27035.
 2012-08-14 18:17:59 +00:00
Nathan Hjelm
d5824f7800 add missing test 
This commit was SVN r27028.
 2012-08-14 03:14:07 +00:00
Nathan Hjelm
3d03d8f08b fix typo in orte_check_alps.m4 
This commit was SVN r27027.
 2012-08-13 23:00:06 +00:00
Nathan Hjelm
8e03f77004 update alps configure scripts 
This commit was SVN r27026.
 2012-08-13 22:57:55 +00:00
Ralph Castain
589acf550c Improve the new MPI_INFO_ENV to better handle Java applications and to correctly report the info for singletons. 
This commit was SVN r27025.
 2012-08-13 22:13:49 +00:00
Ralph Castain
3938ec5361 Remove debug 
This commit was SVN r27024.
 2012-08-13 21:35:21 +00:00
Ralph Castain
49a757e0bd Silly me - now that all daemons are stripping their prefix on the backend, we no longer need to do it as they report 
This commit was SVN r27023.
 2012-08-13 20:48:13 +00:00
Ralph Castain
b9b41d8662 For cases where the alpha+non-zero prefix must be removed from a node name, be sure to do it everywhere we access node names - otherwise, modex methods such as pmi will fail to correctly identify procs on the same node 
This commit was SVN r27022.
 2012-08-13 20:44:56 +00:00
Ralph Castain
c90b7380c1 Sigh - of course, they changed the name of the silly MPI_Info object in the final standard, but not in the proposal. So change to the new MPI_INFO_ENV name. Also, don't set unknown values to "N/A", but just leave them unset. 
This commit was SVN r27012.
 2012-08-12 05:00:57 +00:00
Ralph Castain
cb48fd52d4 Implement the MPI_Info part of MPI-3 Ticket 313. Add an MPI_info object MPI_INFO_GET_ENV that contains a number of run-time related pieces of info. This includes all the required ones in the ticket, plus a few that specifically address recent user questions: 
"num_app_ctx" - the number of app_contexts in the job
"first_rank" - the MPI rank of the first process in each app_context
"np" - the number of procs in each app_context

Still need clarification on the MPI_Init portion of the ticket. Specifically, does the ticket call for returning an error is someone calls MPI_Init more than once in a program? We set a flag to tell us that we have been initialized, but currently never check it.

This commit was SVN r27005.
 2012-08-12 01:28:23 +00:00
Ralph Castain
c4ee297a60 Cleanup the pmi grpcomm module so it passes non-btl modex data correctly. 
This commit was SVN r26992.
 2012-08-10 20:35:50 +00:00
Ralph Castain
e3e9b7345d First cut at updating the ccp launcher to use the state machine 
This commit was SVN r26986.
 2012-08-10 17:09:33 +00:00
Jeff Squyres
3719b6c68b After some further discussion between Jeff, Ralph, and Josh, rever 
r26951.  The feeling is that fixing the actual problem of the command
line parser not always identifying when invalid command line options
were specified (i.e., r26953) was a better solution.

This commit was SVN r26979.

The following SVN revision numbers were found above:
  r26951 --> open-mpi/ompi@1f8df92c3c
  r26953 --> open-mpi/ompi@0b7b3feba9
 2012-08-09 20:56:01 +00:00
Shiqing Fan
e304c19920 This is also used on Windows. 
This commit was SVN r26975.
 2012-08-08 16:44:00 +00:00
George Bosilca
ba879c2c51 Remove the unused map. 
This commit was SVN r26960.
 2012-08-07 12:06:13 +00:00
Shiqing Fan
2f442799f8 fix several typecasts 
This commit was SVN r26957.
 2012-08-07 10:41:53 +00:00
Ralph Castain
1f8df92c3c Remove the confusion over which options are "to" and which are "by" by creating synonyms so that either spelling works. 
This commit was SVN r26951.
 2012-08-05 14:40:38 +00:00
Ralph Castain
53b1a1c976 Cleanly error out when someone asks to map-to <object> if that object doesn't exist on a node. 
This commit was SVN r26950.
 2012-08-04 21:52:36 +00:00
Ralph Castain
61b09a132b Fix bynode mapping of multiple app-contexts 
This commit was SVN r26949.
 2012-08-03 21:45:40 +00:00
Ralph Castain
96f6f94c24 Ensure we don't get trapped in an infinite loop when ranking bynode if something isn't right 
This commit was SVN r26948.
 2012-08-03 21:45:10 +00:00
Ralph Castain
0d878937fe If a callback is set in the state machine, and the state doesn't yet exist, create it 
This commit was SVN r26947.
 2012-08-03 21:43:36 +00:00
Ralph Castain
431d5361ed For those who really preferred our prior mode of operation that mapped procs and only launched daemons on the nodes that had procs on them, introduce the "novm" state machine component. This recreates the old mode of operation by re-ordering the launch sequence so that we allocate, then map, and then launch daemons only on the reqd nodes (instead of across the entire allocation). 
This commit was SVN r26946.
 2012-08-03 16:30:05 +00:00
Ralph Castain
dc22ea5cde A little cleaner on the message about repeated ctrl-c, and re-enable the event so we can abort if we see multiple ctrl-c's that don't meet the time requirement 
This commit was SVN r26945.
 2012-08-03 01:26:18 +00:00
Ralph Castain
e6c72bfd53 Ensure we can forcibly exit even when we are stuck inside of an event by replacing the libevent signal handler with a POSIX one that (a) attempts to trip a libevent termination event and (b) if anothe ctrl-c hits within 5 seconds, just calls exit. 
This commit was SVN r26943.
 2012-08-02 21:15:35 +00:00
Ralph Castain
d818c9d407 Includes a patch from Jeff and Josh: update the simulator module to allow specification of multiple slot and max_slot counts for each node group (but don't require it). Remove the requirement that each node group provide its own topology. Adjust verbosities to allow showing some light debug output to see what nodes have been added without getting a bunch of other stuff. 
This commit was SVN r26936.
 2012-08-02 04:57:13 +00:00
Jeff Squyres
62c2ff7ee7 It's actually ''not'' an error to exit if all routes and children are 
gone.  So exit with 0, not ORTE_ERROR_DEFAULT_EXIT_CODE (which is 1).

This fixes a race condition in the rsh launcher upon termination,
where ORTE would sometimes think that a daemon failed to launch.

This commit was SVN r26935.
 2012-08-01 19:49:19 +00:00
Nathan Hjelm
4557e15c18 oob/ud fix compile error 
This commit was SVN r26933.
 2012-07-31 21:50:34 +00:00
Ralph Castain
6ee35e4977 Add num_local_peers to orte_process_info so we don't keep re-computing it, ensure it is available for direct launch via pmi as well 
This commit was SVN r26931.
 2012-07-31 21:21:50 +00:00
Jeff Squyres
88cbe9c780 .ompi_ignore this component until it can be fixed. 
This commit was SVN r26930.
 2012-07-31 21:02:06 +00:00
Nathan Hjelm
980692804d oob/ud: don't start listening for ud requests unless we have one usable port 
This commit was SVN r26929.
 2012-07-31 19:00:18 +00:00
Ralph Castain
23c2a315a9 Add missing line to set flag indicating at least one port found 
This commit was SVN r26914.
 2012-07-30 17:54:38 +00:00
Ralph Castain
6285f7d8c0 Per request of Shiqing, restore the ccp components 
This commit was SVN r26904.
 2012-07-29 23:49:59 +00:00
Ralph Castain
c7f9a0fa34 Check for recursive use of mpirun - issue error message and abort if detected 
This commit was SVN r26903.
 2012-07-28 21:50:56 +00:00
Ralph Castain
94d11e04fd Add an intermediate state when the VM is ready so that third party tools can take action prior to mapping/launching apps 
This commit was SVN r26902.
 2012-07-28 15:33:09 +00:00
Shiqing Fan
660188307c fix an export declaration name 
This commit was SVN r26895.
 2012-07-27 13:26:24 +00:00
Shiqing Fan
42dfbc7d2f Another CMake scripts update for: 
correctly generate hwloc library
automatically define OMPI/OPAL/ORTE_OMPORTS for user applications
update the f77 bindings

This commit was SVN r26893.
 2012-07-27 11:49:09 +00:00
Ralph Castain
8bc6694a62 Ensure the daemons don't incorrectly declare a failed launch 
This commit was SVN r26875.
 2012-07-26 19:05:06 +00:00
Ralph Castain
07846f12ae Reconnect the rsh/ssh error reporting code for remote spawns to report failure to launch. Ensure the HNP correctly reports non-zero exit status when ssh encounters a problem. 
Thanks to Terry for spotting it!

This commit was SVN r26868.
 2012-07-25 21:46:45 +00:00
Jeff Squyres
e5cfad0c1a This variable is only used in FT builds. 
This commit was SVN r26854.
 2012-07-24 12:48:47 +00:00
Shiqing Fan
8c4a3e1269 correct the symbol dllexports for windows build 
This commit was SVN r26827.
 2012-07-22 08:54:50 +00:00
Shiqing Fan
12d99a9ebb Update the hwloc build on Windows and related files. 
This commit was SVN r26818.
 2012-07-20 12:14:28 +00:00
Abhishek Kulkarni
1ce378b5c6 Make C/R work with nodes > 1. This fix makes sure that the app coordinators send 
the "ready-to-checkpoint" signal to the global coordinator only after ORTE has
initialized.

This commit was SVN r26795.
 2012-07-13 23:37:29 +00:00
Abhishek Kulkarni
1878f276cd Replace the pattern while(flag) { opal_progress() }; in the C/R code 
with the ORTE_WAIT_FOR_COMPLETION macro.

This commit was SVN r26794.
 2012-07-13 23:31:56 +00:00
George Bosilca
772ec212eb Fix another compiler warning. 
This commit was SVN r26775.
 2012-07-10 15:57:42 +00:00
Abhishek Kulkarni
eec5a28aa4 More C/R fixes. 
* Fix a typo introduced by the removal of the notifier framework
* Fix to flush the modex cached data correctly using the orte DB API.

This commit was SVN r26773.
 2012-07-10 01:19:46 +00:00
Abhishek Kulkarni
5c58a1c9c1 Fix C/R support in the trunk. 
Among other things, this patch deals with the following issues:
* fix ompi-checkpoint argument parsing
* ompi-restart -showme prints an extraneous "Restarted child with PID" 
  message. Move around the debug statement to avoid this.
* fixes for the state machine changes

This commit was SVN r26770.
 2012-07-09 23:34:13 +00:00
George Bosilca
ec760454a6 Cleaning ... 
This commit was SVN r26747.
 2012-07-04 21:22:13 +00:00
Ralph Castain
cf4606cdd5 Add debug of nidmap subsystem 
This commit was SVN r26739.
 2012-07-04 00:04:16 +00:00
Ralph Castain
6ae5776904 Cleanup IPV6 build 
This commit was SVN r26738.
 2012-07-04 00:03:50 +00:00
Ralph Castain
1a90471374 Drat - missed the other one 
This commit was SVN r26718.
 2012-07-02 22:18:31 +00:00
Ralph Castain
9a6a969f60 Remove debug 
This commit was SVN r26717.
 2012-07-02 22:18:08 +00:00
Ralph Castain
b83fc41d54 Add a state that allows mpirun or other tools to be notified of a job completion prior to terminating so that alternative actions can be performed. 
This commit was SVN r26716.
 2012-07-02 22:16:32 +00:00
Ralph Castain
e335de3564 Refactor ompi_info, splitting it into parts according to the layer involved. Thus, we call down to the opal layer to get those frameworks and components, and down to the orte layer to get those. Still some abstraction breaks, but they mostly involve renaming of OMPI_foo labels that have been around since before we split the build system by layer. 
This commit was SVN r26695.
 2012-06-28 18:23:34 +00:00
Ralph Castain
8bebf2fa47 Ensure we don't build the MR iof components unless hadoop support is enabled 
This commit was SVN r26694.
 2012-06-28 18:20:15 +00:00
Ralph Castain
9aa821d8b4 Add missing file to tarball 
This commit was SVN r26688.
 2012-06-28 02:57:10 +00:00
Ralph Castain
0dfe29b1a6 Roll in the rest of the modex change. Eliminate all non-modex API access of RTE info from the MPI layer - in some cases, the info was already present (either in the ompi_proc_t or in the orte_process_info struct) and no call was necessary. This removes all calls to orte_ess from the MPI layer. Calls to orte_grpcomm remain required. 
Update all the orte ess components to remove their associated APIs for retrieving proc data. Update the grpcomm API to reflect transfer of set/get modex info to the db framework.

Note that this doesn't recreate the old GPR. This is strictly a local db storage that may (at some point) obtain any missing data from the local daemon as part of an async methodology. The framework allows us to experiment with such methods without perturbing the default one.

This commit was SVN r26678.
 2012-06-27 14:53:55 +00:00
Brian Barrett
b22faedd9d Remove the Portals4 SHMEM reference implementation runtime support, as we're 
no longer using the runtime provided by the reference implementation.

Remove the Catamount support from ORTE, since we're no longer supporting
Catamount.  Left the Catamount timer component, because I'm not sure whether
it's used on the XTs running CNL.

This commit was SVN r26677.
 2012-06-27 14:17:43 +00:00
Josh Hursey
28681deffa Backout the ORCA commit. :( 
There is a linking issue on Mac OSX that needs to be addressed before this is able to come back into the trunk.

This commit was SVN r26676.
 2012-06-27 01:28:28 +00:00
Josh Hursey
542330e3a7 Commit of ORCA: Open MPI Runtime Collaborative Abstraction 
This is a runtime interposition project that sits between the OMPI and ORTE layers in Open MPI.

The project is described on the wiki:
  https://svn.open-mpi.org/trac/ompi/wiki/Runtime_Interposition

And on this email thread:
  http://www.open-mpi.org/community/lists/devel/2012/06/11109.php

This commit was SVN r26670.
 2012-06-26 21:42:16 +00:00
Ralph Castain
a34f09e67a Ensure common port is off when not being used 
This commit was SVN r26666.
 2012-06-26 16:09:58 +00:00
Ralph Castain
92527da4e3 Remove unused component 
This commit was SVN r26660.
 2012-06-26 00:49:28 +00:00
Ralph Castain
0103f82918 Turn off the common port for slurm for now 
This commit was SVN r26656.
 2012-06-25 21:55:51 +00:00
Ralph Castain
b990c65a53 Remove another antiquated dss function - the 'size' API isn't used anywhere since the GPR went away 
This commit was SVN r26646.
 2012-06-25 13:33:45 +00:00
Shiqing Fan
6f746cdb33 remove a unused file. 
This commit was SVN r26645.
 2012-06-25 10:17:21 +00:00
Ralph Castain
abe7dd8274 Cleanup the dss by removing unused functions 
This commit was SVN r26644.
 2012-06-23 21:20:09 +00:00
Ralph Castain
9680c52f5e Add mrplus examples to tarball 
This commit was SVN r26643.
 2012-06-23 02:40:46 +00:00
Jeff Squyres
148ae6d6e3 This commit unifies the configury of some verbs-lovin' components. 
* Add new configure command line options and deprecate some old ones:
   * --with-verbs replaces --with-openib
   * --with-verbs-libdir replaces --with-openib-libdir
 * If you specify --with-openib[-libdir] without
   --with-verbs[-libdir], you'll get a "these options have been
   deprecated!" warning, but then they'll act just like
   --with-verbs[--libdir]. 

  '''Sidenote:''' Note that we are not renaming any components at this
  time, nor are we renaming the top-level OMPI_CHECK_OPENIB m4 macro
  (which is pretty strongly tied to the openib BTL and is bastaridzed
  by the ofud BTL).  Note that there will likely be more changes in
  this area coming soon (next week?) when some long-standing changes
  move to the SVN trunk: some openib BTL infrastructure will move to
  ompi/mca/common, and its configury gets split up / refactored.

We extend our philosophy of other --with-<foo> configure options of
--with-verbs to ''all'' verbs-lovin components:

 * If you specify --with-verbs, then all verbs-lovin' components must
   configure successfully (or abort).  This currently means: OOB ud,
   BTL ofud, BTL openib.
 * If you specify --with-verbs=DIR, then all verbs-lovin' component
   must configure successfully (or abort), and will use DIR to find
   verbs headers and libraries.
 * If you specify --without-verbs, then all verbs-lovin' components
   will be ignored.

This commit also fixes a problem where the --with-openib=DIR form
would not use DIR for ''all'' verbs-lovin' components (I think only
BTL openib and BTL ofud used that DIR).  Now all of them do, as does
hwloc (because hwloc has some !OpenFabrics helper functions that
require ibv types from verbs.h).

There's a little new m4 infrastructure worth mentioning:

 * If you create a new verbs-lovin' component (i.e., a component that
   need verbs), your configure.m4 should
   AC_REQUIRE([OPAL_CHECK_VERBS_DIR]). 
 * You can then use three global shell variables: $opal_want_verbs,
   $opal_verbs_dir, $opal_verbs_libdir, which will be set as follows:
   * opal_want_verbs will be "yes" and opal_verbs_dir and
     opal_verbs_libdir will both be set to directory values, '''OR'''
   * opal_want_verbs will be "no" and opal_verbs_dir and
     opal_verbs_libdir will both be set empty

This commit was SVN r26640.
 2012-06-22 19:53:56 +00:00
Ralph Castain
e6f3586415 Remove the orte notifier framework, per discussion at the devel meeting and follow-up with Jeff (who took the action item) 
This commit was SVN r26637.
 2012-06-22 18:09:23 +00:00
Ralph Castain
60758faa55 Fix data type 
This commit was SVN r26633.
 2012-06-21 23:48:55 +00:00
Ralph Castain
e9591f2563 Fix tree spawn in the rsh/qrsh environment 
This commit was SVN r26631.
 2012-06-21 21:29:28 +00:00
Brian Barrett
9af72072a3 Use MKDIR_P instead of mkdir_p in Makefiles, as MKDIR_P is the only one 
defined in recent versions of AC/AM.

This commit was SVN r26625.
 2012-06-21 16:52:37 +00:00
Ralph Castain
019857b616 Ensure that we don't attempt to use common ports if --disable-static was specified. 
This commit was SVN r26620.
 2012-06-20 03:14:11 +00:00
Ralph Castain
0a713cd27e Add database framework to ORTE and refactor modex code to utilize it. Create the "hash" db component from the prior modex db code. Leave the other components ignored for now - will activate them later. 
Modex is still a blocking operation at this point.

This commit was SVN r26618.
 2012-06-19 13:38:42 +00:00
Ralph Castain
9e0bb6ae28 Revert r26600 and r26601 for a couple of reasons: 
1. they modified the OMPI-ORTE interface, which is something I promised to avoid doing unless absolutely necessary, and

2. the framework ident is already in the component name key provided to the modex db. What is missing is the project ident, but as Jeff and I discussed last week, we really need to add that field to the component struct anyway to avoid multi-project collisions on framework names. That will be done over the next couple of weeks as a separate effort.

This commit was SVN r26613.

The following SVN revision numbers were found above:
  r26600 --> open-mpi/ompi@5ba4deff07
  r26601 --> open-mpi/ompi@0e3094c318
 2012-06-16 09:11:03 +00:00
Ralph Castain
9b026c6695 For now, run MTT with the use_common_port option enabled. This would be the desirable scenario for users, especially at scale, so let's see if it creates any issues. 
This commit was SVN r26609.
 2012-06-15 15:46:38 +00:00
Ralph Castain
3c2a03b16d Update the other routed components to use common ports. Per conversation with Josh, remove the "cm" component. 
This commit was SVN r26608.
 2012-06-15 15:36:08 +00:00
Ralph Castain
96c778656a Improve launch performance on clusters that use dedicated nodes by instructing the orteds to use the same port as the HNP, thus allowing them to "rollup" their initial callback via the routed network. This substantially reduces the HNP bottleneck and the number of ports opened by the HNP. 
Restore enable-static-ports option by default - the Cray will have to disable it to get around their library issues, but that's just a warning problem as opposed to blocking the build.

This commit was SVN r26606.
 2012-06-15 10:15:07 +00:00
Ralph Castain
0e3094c318 Update the other grpcomm modules to new API 
This commit was SVN r26601.
 2012-06-14 03:28:48 +00:00
Ralph Castain
5ba4deff07 Extend the modex database to support multiple projects and frameworks that might have duplicate component names. No visible API change in the BTL's as it was executed solely in the ompi modex code. 
This commit was SVN r26600.
 2012-06-14 02:55:06 +00:00
Ralph Castain
ecc51d8583 Add missing endif 
This commit was SVN r26596.
 2012-06-12 15:07:09 +00:00
Ralph Castain
078a4667e4 Some more cleanup on direct routed when daemons are involved 
This commit was SVN r26594.
 2012-06-11 23:46:22 +00:00
Ralph Castain
cee5a75d19 Revert the default configuration to no orte progress thread and no libevent thread support until we can get more of the kinks ironed out. 
This commit was SVN r26593.
 2012-06-11 20:52:28 +00:00
Ralph Castain
9506ac1617 Remove debug 
This commit was SVN r26592.
 2012-06-11 20:02:53 +00:00
Ralph Castain
269cb2b8d9 Some cleanup to remove calls to opal_progress when running with orte progress threads, and to ensure that all orte-related events are in the orte event base. 
This commit was SVN r26591.
 2012-06-11 19:59:53 +00:00
Ralph Castain
75e66ad51e Restore the direct routed component 
This commit was SVN r26590.
 2012-06-11 17:16:02 +00:00
Brian Barrett
7406ef1241 Make all the PMI components depend on the common pmi library and properly 
install the common pmi library

This commit was SVN r26588.
 2012-06-11 15:58:09 +00:00
Ralph Castain
2812579246 Just because we find an IB device does not mean we can get a QP on it. Check to see if we can before we select the UD OOB module for use. 
This commit was SVN r26587.
 2012-06-10 01:42:51 +00:00
Ralph Castain
0442a807c0 Default the OOB to the "ud" component IFF the HNP finds itself on a node with a supported Infiniband device. Ensure that the daemons all pick the matching component by dictating the selection via mca param on the orted cmd line. 
This commit was SVN r26582.
 2012-06-08 01:23:08 +00:00
Ralph Castain
05122a2f93 Make debruijn the default routed component. Update the radix component to "short-circuit" the tree when the job size permits 
This commit was SVN r26580.
 2012-06-08 00:35:36 +00:00
Ralph Castain
ffcca0185a Remove no longer needed component 
This commit was SVN r26578.
 2012-06-08 00:18:59 +00:00
Ralph Castain
980768965f Remove unused and unsupported component 
This commit was SVN r26577.
 2012-06-07 23:48:06 +00:00
Ralph Castain
350900f70e Remove unused and unsupported component 
This commit was SVN r26576.
 2012-06-07 23:47:35 +00:00
Nathan Hjelm
625c8078c3 oob/ud: fix typo 
This commit was SVN r26569.
 2012-06-07 19:21:23 +00:00
Ralph Castain
7a94a52420 No reason not to build this 
This commit was SVN r26568.
 2012-06-07 19:11:44 +00:00
Ralph Castain
5876496f4c Enable orte progress threads and libevent thread support by default 
This commit was SVN r26565.
 2012-06-07 04:25:00 +00:00
Shiqing Fan
2abf783fa0 Remove a unnecessary definition before the real one. 
This commit was SVN r26562.
 2012-06-06 14:15:39 +00:00
Ralph Castain
166d254d4e Add new routed component 
This commit was SVN r26557.
 2012-06-06 11:53:12 +00:00
Ralph Castain
d6279fc971 Fix the debugger daemon launch support to fit the new state machine. Treat debugger daemons just like any other job, except that we map them only to nodes where an app process currently exists (as opposed to every node in the system). Trigger breakpoint and rank0 release only after the debugger daemons are in position. 
This commit was SVN r26556.
 2012-06-06 02:01:23 +00:00
Jeff Squyres
0b8849e2c4 Make "mpirun --report-bindings" have a user-friendly output (i.e., 
readable by normal human beings, vs. having a bitmap of physical
PU's).  Use the new hwloc base prettyprint functions to generate the
output. 

This commit was SVN r26533.
 2012-06-01 16:35:31 +00:00
Jeff Squyres
99c5afb397 Remove clang compiler warnings. 
This commit was SVN r26523.
 2012-05-29 23:36:06 +00:00
Ralph Castain
b0938a254e Dont use mutex where it isn't needed 
This commit was SVN r26521.
 2012-05-29 20:21:11 +00:00
Ralph Castain
32b66c166b Missed one blasted spot 
This commit was SVN r26520.
 2012-05-29 20:20:10 +00:00
Ralph Castain
9bedb25dda Cleanup some compiler warnings, some of which are actual logic errors 
This commit was SVN r26519.
 2012-05-29 20:11:51 +00:00
Ralph Castain
d7ac424d8d Silence optimized build warnings 
This commit was SVN r26518.
 2012-05-29 19:55:47 +00:00
Ralph Castain
bf5ec1ac0c Silence optimized build warnings 
This commit was SVN r26517.
 2012-05-29 19:55:31 +00:00