ports/openmpi
ports/openmpi
1
1
Форкнуть 0
Код Релизы Активность
17 625 коммитов 3 Ветки 0 Теги 130 MiB
bdedd8b0d3
Граф коммитов

474 Коммитов

Автор SHA1 Сообщение Дата
Nathan Hjelm
bdedd8b0d3 Per RFC modify the behavior of mca_base_components_close to NOT close the output. Modify frameworks to always close their output and set to -1. 
Reasoning: The old behavior was a little confusing. mca_base_components_open does not open an output stream so it is a little unexpected that mca_base_components_close does. To add to this several frameworks (that don't use mca_base_components_close) failed to close their output in the framework close function and others closed their output a second time. This change is an improvement to the symantics of mca_base_components_open/close as they are now symetric in their functionality.

This commit was SVN r27570.
 2012-11-06 19:09:26 +00:00
Brian Barrett
e61c00212d Add files found in svn but not tarball 
This commit was SVN r27549.
 2012-11-01 02:27:03 +00:00
Nathan Hjelm
2acd0f83de Revert "Revert r27451 and r27456 - the cmd line parser is incorrectly marking the application as an MCA parameter". 
It appears the problem was not with the command line parser but the rsh plm. I don't know why this problem was not occuring before the command line parser changes but it appears to be resolved now.

This commit was SVN r27527.

The following SVN revision numbers were found above:
  r27451 --> open-mpi/ompi@d59034e6ef
  r27456 --> open-mpi/ompi@ecdbf34937
 2012-10-30 19:45:18 +00:00
Nathan Hjelm
df9bd0ed59 fix bug in plm/rsh that could add extraneous mca options to the orted argv 
cmr:v1.7

This commit was SVN r27526.
 2012-10-30 19:40:04 +00:00
Ralph Castain
e6014bf2e1 Revert r27451 and r27456 - the cmd line parser is incorrectly marking the application as an MCA parameter 
This commit was SVN r27477.

The following SVN revision numbers were found above:
  r27451 --> open-mpi/ompi@d59034e6ef
  r27456 --> open-mpi/ompi@ecdbf34937
 2012-10-24 18:38:44 +00:00
Ralph Castain
7574d6673b If someone provides the launch_agent cmd, then don't prefix it 
cmr:v1.7

This commit was SVN r27473.
 2012-10-24 16:14:04 +00:00
Nathan Hjelm
d59034e6ef MCA: remove deprecated mca_base_param functions (mca_base_param_register_int, mca_base_param_register_string, mca_base_param_environ_variable). Remove all uses of deprecated functions. 
cmr:v1.7

This commit was SVN r27451.
 2012-10-17 20:17:37 +00:00
Ralph Castain
285a3b168d Add an ability to specify the max number of simultaneous procs/node for an application when operating in staged mode. Change some debug statements from OPAL_OUTPUT_VERBOSE to opal_output_verbose so they are available in optimized builds. 
This commit was SVN r27445.
 2012-10-14 03:31:32 +00:00
Ralph Castain
f592967685 Add missing retain to maintain correct accounting on nodes 
This commit was SVN r27352.
 2012-09-20 02:30:53 +00:00
Ralph Castain
78ccb097f0 Fix vm setup in unmanaged environments - needs to construct a node list in the same way we now do for mapping 
This commit was SVN r27256.
 2012-09-07 01:53:19 +00:00
Ralph Castain
bae5dab916 If (and only if) a user requests, set the default number of slots on any node to the number of objects of the specified type. This *only* takes effect in an unmanaged environment - i.e., if an external resource manager assigns us a number of slots, then that is what we use. However, if we are using a hostfile, then the user may or may not have given us a value for the number of slots on each node. 
For those nodes (and *only* those nodes) where the user does *not* specify a slot count, we will set the number of slots according to their direction: either to the number of cores, numas, sockets, or hwthreads. Otherwise, the slot count is set to 1.

Note that the default behavior remains unchanged: in the absence of any value for #slots, and in the absence of any directive to set #slots, we will set #slots=1.

This commit was SVN r27236.
 2012-09-04 20:58:26 +00:00
Ralph Castain
a3b08f5800 Fix a few things relating to comm_spawn that causes new daemons to be launched. Ensure that all new daemons receive a full pidmap. Properly mark the daemon job as "updated" when daemons are added 
This commit was SVN r27177.
 2012-08-29 03:11:37 +00:00
Ralph Castain
98580c117b Introduce staged execution. If you don't have adequate resources to run everything without oversubscribing, don't want to oversubscribe, and aren't using MPI, then staged execution lets you (a) run as many procs as there are available resources, and (b) start additional procs as others complete and free up resources. Adds a new mapper as well as a new state machine. 
Remove some stale configure.m4's we no longer need.

Optimize the nidmaps a bit by only sending info that has changed each time, instead of sending a complete copy of everything. Makes no difference for the typical MPI job - only impacts things like staged execution where we are sending multiple (possibly many) launch messages.

This commit was SVN r27165.
 2012-08-28 21:20:17 +00:00
Ralph Castain
6e8c97c77c Per Sam's eagle-eyed review, free the malloc'd memory if getcwd fails for some strange reason. 
This commit was SVN r27150.
 2012-08-27 19:15:16 +00:00
Ralph Castain
b4a544ad2a Per discussion with Josh, use the --preload-xxx cmd line options to broadcast files to all nodes. Add --set-cwd-to-session-dir option to start procs in their session directories. Add OMPI_FILE_LOCATION envar to tell procs where their prepositioned files went. 
This commit was SVN r27125.
 2012-08-23 21:28:05 +00:00
Ralph Castain
ed4b354846 Ensure we pass along user-specified mca params from the cmd line when doing a tree spawn, but don't extend the cmd line with duplicates or things that shouldn't be there 
This commit was SVN r27117.
 2012-08-22 21:41:50 +00:00
Ralph Castain
49a757e0bd Silly me - now that all daemons are stripping their prefix on the backend, we no longer need to do it as they report 
This commit was SVN r27023.
 2012-08-13 20:48:13 +00:00
Ralph Castain
b9b41d8662 For cases where the alpha+non-zero prefix must be removed from a node name, be sure to do it everywhere we access node names - otherwise, modex methods such as pmi will fail to correctly identify procs on the same node 
This commit was SVN r27022.
 2012-08-13 20:44:56 +00:00
Ralph Castain
e3e9b7345d First cut at updating the ccp launcher to use the state machine 
This commit was SVN r26986.
 2012-08-10 17:09:33 +00:00
Ralph Castain
431d5361ed For those who really preferred our prior mode of operation that mapped procs and only launched daemons on the nodes that had procs on them, introduce the "novm" state machine component. This recreates the old mode of operation by re-ordering the launch sequence so that we allocate, then map, and then launch daemons only on the reqd nodes (instead of across the entire allocation). 
This commit was SVN r26946.
 2012-08-03 16:30:05 +00:00
Ralph Castain
6285f7d8c0 Per request of Shiqing, restore the ccp components 
This commit was SVN r26904.
 2012-07-29 23:49:59 +00:00
Ralph Castain
94d11e04fd Add an intermediate state when the VM is ready so that third party tools can take action prior to mapping/launching apps 
This commit was SVN r26902.
 2012-07-28 15:33:09 +00:00
Ralph Castain
8bc6694a62 Ensure the daemons don't incorrectly declare a failed launch 
This commit was SVN r26875.
 2012-07-26 19:05:06 +00:00
Ralph Castain
07846f12ae Reconnect the rsh/ssh error reporting code for remote spawns to report failure to launch. Ensure the HNP correctly reports non-zero exit status when ssh encounters a problem. 
Thanks to Terry for spotting it!

This commit was SVN r26868.
 2012-07-25 21:46:45 +00:00
Jeff Squyres
e5cfad0c1a This variable is only used in FT builds. 
This commit was SVN r26854.
 2012-07-24 12:48:47 +00:00
Abhishek Kulkarni
5c58a1c9c1 Fix C/R support in the trunk. 
Among other things, this patch deals with the following issues:
* fix ompi-checkpoint argument parsing
* ompi-restart -showme prints an extraneous "Restarted child with PID" 
  message. Move around the debug statement to avoid this.
* fixes for the state machine changes

This commit was SVN r26770.
 2012-07-09 23:34:13 +00:00
Ralph Castain
b83fc41d54 Add a state that allows mpirun or other tools to be notified of a job completion prior to terminating so that alternative actions can be performed. 
This commit was SVN r26716.
 2012-07-02 22:16:32 +00:00
Ralph Castain
0dfe29b1a6 Roll in the rest of the modex change. Eliminate all non-modex API access of RTE info from the MPI layer - in some cases, the info was already present (either in the ompi_proc_t or in the orte_process_info struct) and no call was necessary. This removes all calls to orte_ess from the MPI layer. Calls to orte_grpcomm remain required. 
Update all the orte ess components to remove their associated APIs for retrieving proc data. Update the grpcomm API to reflect transfer of set/get modex info to the db framework.

Note that this doesn't recreate the old GPR. This is strictly a local db storage that may (at some point) obtain any missing data from the local daemon as part of an async methodology. The framework allows us to experiment with such methods without perturbing the default one.

This commit was SVN r26678.
 2012-06-27 14:53:55 +00:00
Ralph Castain
a34f09e67a Ensure common port is off when not being used 
This commit was SVN r26666.
 2012-06-26 16:09:58 +00:00
Ralph Castain
0103f82918 Turn off the common port for slurm for now 
This commit was SVN r26656.
 2012-06-25 21:55:51 +00:00
Ralph Castain
e6f3586415 Remove the orte notifier framework, per discussion at the devel meeting and follow-up with Jeff (who took the action item) 
This commit was SVN r26637.
 2012-06-22 18:09:23 +00:00
Ralph Castain
e9591f2563 Fix tree spawn in the rsh/qrsh environment 
This commit was SVN r26631.
 2012-06-21 21:29:28 +00:00
Ralph Castain
96c778656a Improve launch performance on clusters that use dedicated nodes by instructing the orteds to use the same port as the HNP, thus allowing them to "rollup" their initial callback via the routed network. This substantially reduces the HNP bottleneck and the number of ports opened by the HNP. 
Restore enable-static-ports option by default - the Cray will have to disable it to get around their library issues, but that's just a warning problem as opposed to blocking the build.

This commit was SVN r26606.
 2012-06-15 10:15:07 +00:00
Ralph Castain
ecc51d8583 Add missing endif 
This commit was SVN r26596.
 2012-06-12 15:07:09 +00:00
Ralph Castain
269cb2b8d9 Some cleanup to remove calls to opal_progress when running with orte progress threads, and to ensure that all orte-related events are in the orte event base. 
This commit was SVN r26591.
 2012-06-11 19:59:53 +00:00
Ralph Castain
0442a807c0 Default the OOB to the "ud" component IFF the HNP finds itself on a node with a supported Infiniband device. Ensure that the daemons all pick the matching component by dictating the selection via mca param on the orted cmd line. 
This commit was SVN r26582.
 2012-06-08 01:23:08 +00:00
Ralph Castain
9bedb25dda Cleanup some compiler warnings, some of which are actual logic errors 
This commit was SVN r26519.
 2012-05-29 20:11:51 +00:00
Ralph Castain
be6ed9c2df Allow partial use of allocations by specifying the max number of daemons (i.e., max VM size) for the job 
This commit was SVN r26499.
 2012-05-27 16:48:19 +00:00
Ralph Castain
96bfeb591c Ensure flag is passed to remote daemons 
This commit was SVN r26383.
 2012-05-03 22:31:25 +00:00
Ralph Castain
45fee2b491 Resolve the case where only the HNP is in the system (i.e., single-node operation) 
This commit was SVN r26382.
 2012-05-03 18:00:01 +00:00
Ralph Castain
b2f77bf08f Extend the iof by adding two new components to support map-reduce IO chaining. Add a mapreduce tool for running such applications. 
Fix the state machine to support multiple jobs being simultaneously launched as this is not only required for mapreduce, but can happen under comm-spawn applications as well.

This commit was SVN r26380.
 2012-05-02 21:00:22 +00:00
Ralph Castain
3461809341 Fix reporting of launch progress so the numbers are correct and appear when they should 
This commit was SVN r26342.
 2012-04-26 00:10:09 +00:00
Ralph Castain
71805bf7e4 Clearout the startup_timeout event if the job did in fact start. Have ORTE_TERMINATE use the job state macro so debug will show where it was called 
This commit was SVN r26334.
 2012-04-25 01:05:17 +00:00
Ralph Castain
4d16790836 Fix collectives for jobs running across partial allocations 
This commit was SVN r26267.
 2012-04-13 00:38:47 +00:00
Ralph Castain
19630ca28d Remove stale code 
This commit was SVN r26252.
 2012-04-07 13:33:40 +00:00
Ralph Castain
93bbeabc55 Remove stale code 
This commit was SVN r26251.
 2012-04-07 13:33:30 +00:00
Ralph Castain
b6cde9a8d1 Remove stale code 
This commit was SVN r26250.
 2012-04-07 13:33:18 +00:00
George Bosilca
319f76d66a Low hanging fruit. Remove a declared but not defined function. 
This commit was SVN r26245.
 2012-04-06 15:43:28 +00:00
Ralph Castain
ed197acaa2 Eliminate stale code 
This commit was SVN r26244.
 2012-04-06 15:31:13 +00:00
Ralph Castain
bd8b4f7f1e Sorry for mid-day commit, but I had promised on the call to do this upon my return. 
Roll in the ORTE state machine. Remove last traces of opal_sos. Remove UTK epoch code.

Please see the various emails about the state machine change for details. I'll send something out later with more info on the new arch.

This commit was SVN r26242.
 2012-04-06 14:23:13 +00:00