ports/openmpi
ports/openmpi
1
1
Форкнуть 0
Код Релизы Активность
16 367 коммитов 3 Ветки 0 Теги 130 MiB
b2411fe131
Граф коммитов

3391 Коммитов

Автор SHA1 Сообщение Дата
Nathan Hjelm
34afb5a0fa first cut at general pmi check 
This commit was SVN r25234.
 2011-10-05 17:14:24 +00:00
George Bosilca
80c02647c8 Each level (OPAL/ORTE/OMPI) should only return it's own constants, 
instead of the current mismatch.

This commit was SVN r25230.
 2011-10-04 14:50:31 +00:00
George Bosilca
c6d6c9aece Remove some #if by using the correct macro (aka. ORTE_EPOCH_CMP). 
This commit was SVN r25229.
 2011-10-04 14:42:40 +00:00
Samuel Gutierrez
25cbf79592 modifications to ras alps. this commit allows users to mpirun without having to set id environment variables (BASIL_RESERVATION_ID, OMPI_ALPS_RESID). note, however, that we preserved the old behavior. if an id environment variable is set, it will be obeyed and our new code path is essentially bypassed. if we missed something, please yell at us. with this commit, the use of ras-alps-command.sh is no longer needed... at least that is our hope. 
This commit was SVN r25181.
 2011-09-26 21:31:08 +00:00
Ralph Castain
8347385630 Fix the radix routed component. 
This commit was SVN r25175.
 2011-09-22 09:32:53 +00:00
Jeff Squyres
ecd603256a * Rename opal_hwloc_components to opal_hwloc_base_components 
* Fix some comments

This commit was SVN r25150.
 2011-09-17 11:54:36 +00:00
Ralph Castain
1cd7b02df3 Add a set of default errmgr components that support solely the default "everything dies on error" behavior. Set their priority to be selected by default, but provide params to adjust those priorities to allow other component selection. 
This commit was SVN r25139.
 2011-09-13 22:03:45 +00:00
Ralph Castain
3c4f04f4d9 Ensure opal_hwloc_topology is NULL after being destroyed 
This commit was SVN r25138.
 2011-09-13 19:21:10 +00:00
Nathan Hjelm
079ccdf8b1 fix debugger co-location launching 
This commit was SVN r25136.
 2011-09-13 15:08:03 +00:00
Ralph Castain
ca7638553f Remove stale code 
This commit was SVN r25133.
 2011-09-12 23:00:41 +00:00
Ralph Castain
556a05566e Silence warning 
This commit was SVN r25130.
 2011-09-12 16:21:51 +00:00
Shiqing Fan
0aea775837 Set the compiler flags in a better way. 
This commit was SVN r25125.
 2011-09-12 08:24:27 +00:00
Ralph Castain
92c7372e20 Per the RFC from Jeff, move hwloc from opal/mca/common to its own static framework ala libevent. Have ORTE daemons collect the topology info at startup and, if --enable-hwloc-xml is set, send that info back to the HNP for later use. The HNP only retains unique topology "templates" to reduce memory footprint. Have the daemon include the local topology info in the nidmap buffer sent to each app so the apps don't all hammer the local system to discover it for themselves. 
Remove the sysinfo framework as hwloc replaces that functionality.

This commit was SVN r25124.
 2011-09-11 19:02:24 +00:00
Ralph Castain
2091e39bee Record the file descriptor on the read event when building optimized 
This commit was SVN r25123.
 2011-09-11 18:57:14 +00:00
Rainer Keller
9d5afc58c6 - Fix breakage of the epoch changes with PGI: 
Don't juse include pre-processor macros between two strins ("s1" #if 0 ... "s2")...
   Rather print out the epoch as 0 always...

This commit was SVN r25110.
 2011-08-31 08:40:31 +00:00
Wesley Bland
f8740e5478 Correct a typo reported by Pasha. 
This commit was SVN r25109.
 2011-08-30 18:44:52 +00:00
Ralph Castain
03ddf8520b Resolve not-used warnings 
This commit was SVN r25101.
 2011-08-27 14:27:15 +00:00
Ralph Castain
56ebfa23cc ORTE configure options belong in orte/config, not opal. 
This commit was SVN r25100.
 2011-08-27 14:23:49 +00:00
Wesley Bland
f542ecd578 Fix a couple of problems with the resil code not compiling. 
This commit was SVN r25099.
 2011-08-27 03:21:00 +00:00
George Bosilca
a4245b8d63 Remove some warnings related to the resilience patch. 
This commit was SVN r25097.
 2011-08-27 00:15:34 +00:00
George Bosilca
67ec5a0556 While doing cleanup remove pending warnings. 
This commit was SVN r25095.
 2011-08-26 23:38:06 +00:00
George Bosilca
fc1184c41f Remove a warnings introduced by the epoch commit. 
This commit was SVN r25094.
 2011-08-26 23:36:52 +00:00
Wesley Bland
4e7ff0bd5e By popular demand the epoch code is now disabled by default. 
To enable the epochs and the resilient orte code, use the configure flag:

--enable-resilient-orte

This will define both:

ORTE_ENABLE_EPOCH
ORTE_RESIL_ORTE

This commit was SVN r25093.
 2011-08-26 22:16:14 +00:00
Ralph Castain
1c08a4006c Refactor some code to remove a few API handles from errmgr. Reviewed/tested by Wes. 
This commit was SVN r25064.
 2011-08-18 16:24:45 +00:00
Ralph Castain
e58623cd5b Bring alps back to full operations by correctly computing daemon names. Unfortunately, alps doesn't assign cnos rank in node-based order - i.e., cnos rank=0 isn't necessarily on the first node of the execution. So adjust when using static ports. 
Add some debug to nidmap

Ensure that the HNP's node name is not included in the regex when launching via rshbase as that node is automatically included in the daemon map.

This commit was SVN r25063.
 2011-08-18 14:59:18 +00:00
Wesley Bland
a2a20c3766 I believe this should fix the race condition that Terry is seeing in the MTT 
tests. It appears that nothing in the errmgr was using the mutexes to protect
the odls child list.

This commit was SVN r25062.
 2011-08-18 14:52:30 +00:00
Shiqing Fan
6d0ab9bd6c One library was missing for linking orterun on Windows. 
This commit was SVN r25057.
 2011-08-18 09:33:41 +00:00
Ralph Castain
23f47295a8 Add even more debug 
This commit was SVN r25053.
 2011-08-16 16:41:33 +00:00
Ralph Castain
d624d43f69 Add more debug 
This commit was SVN r25052.
 2011-08-16 15:47:37 +00:00
Ralph Castain
3d96497581 Add debug 
This commit was SVN r25050.
 2011-08-16 12:22:05 +00:00
Shiqing Fan
7292ee2387 One .windows file is missing in the tarball. 
This commit was SVN r25049.
 2011-08-15 10:21:25 +00:00
Shiqing Fan
3af7c9f7bb Complete the MinGW build support on Windows. 
This commit was SVN r25048.
 2011-08-15 09:47:23 +00:00
Shiqing Fan
627f1dd351 Correct several export declarations. 
This commit was SVN r25047.
 2011-08-15 09:45:51 +00:00
Ralph Castain
ca3d29a1e6 Extend regex support to a bigger audience 
This commit was SVN r25046.
 2011-08-12 21:02:48 +00:00
Ralph Castain
ea4e2c2db4 Unused variables 
This commit was SVN r25045.
 2011-08-12 21:02:09 +00:00
Jeff Squyres
1cbfb53801 r24976 wasn't quite right -- you now actually get a warning if you 
specify btl_tcp_if_include because btl_tcp_if_exclude is defaulted to
the loopback devices.

This commit does a few things:

 * Introduce a new OPAL MCA base function:
   mca_base_param_check_exclusive_string().  It checks to see that the
   ''user'' does not set two MCA parameters that are mutually
   exclusive by checking the source of those MCS param values.
 * Use the above function in many BTLs (and the OOB TCP) to ensure
   that <foo>_if_include and <foo>_if_exclude are not both specified
   ''by the user''.
 * Re-arrange many of these BTLs to move their MCA registration code
   into a separate component_register() function (vs. the
   component_open() function).

This code has been nominally reviewed and checked by Ralph, George,
Terry, and Shiqing.

This commit was SVN r25043.

The following SVN revision numbers were found above:
  r24976 --> open-mpi/ompi@8f4ac54336
 2011-08-10 17:24:36 +00:00
Ralph Castain
b360c98afd Per request from Pasha, revert r25004 - but modified a touch to reflect fact that opal_argv_append copies the provided string, so we don't need to print it and then free it. 
This commit was SVN r25037.

The following SVN revision numbers were found above:
  r25004 --> open-mpi/ompi@2418831bea
 2011-08-09 22:42:27 +00:00
Nathan Hjelm
aa3d302a05 use persistent rml_recv in iof 
This commit was SVN r25035.
 2011-08-09 21:30:12 +00:00
Ralph Castain
f1951e7ccd If we are abnormally terminating, then don't wait for orteds to report back. Send them a "halt_vm" command, which instructs them to kill their local procs and immediately terminate, doing their best to cleanup on the way out. 
Also do a little cleanup on debug output in rshbase.

This commit was SVN r25033.
 2011-08-09 17:42:19 +00:00
Wesley Bland
67feeb6aca Move the errmgr code back. This shouldn't cause the svn problems that I 
apparently caused last time. Sorry about that. This one will just be a big
changelog.  

This commit was SVN r25016.
 2011-08-08 16:01:08 +00:00
Wesley Bland
09274cd047 Make sure that the epoch is initialized everywhere so we don't get weird output 
during valgrind. This shouldn't have caused any problems with any actual
execution. Just extra warnings in valgrind.

This commit was SVN r25015.
 2011-08-08 15:11:55 +00:00
Ralph Castain
8014e3429e Don't double-count procs as they are launched 
This commit was SVN r25011.
 2011-08-08 06:05:23 +00:00
Ralph Castain
7b9f958dcf Add some missing error strings. Update test to show silent errors 
This commit was SVN r25010.
 2011-08-08 04:21:02 +00:00
Ralph Castain
4083dc617f Fix computation of number of required files and file descriptors - it only depends on the total number of local procs, not on the number of procs in the entire job! 
This commit was SVN r25008.
 2011-08-08 04:09:40 +00:00
Ralph Castain
590ac70e88 Add a simple test program for error string output 
This commit was SVN r25007.
 2011-08-07 21:32:25 +00:00
Ralph Castain
8b3c562b84 Adjust verbosity levels to make it easier to debug at scale 
This commit was SVN r25006.
 2011-08-07 21:14:21 +00:00
Ralph Castain
2418831bea Pass the nodelist to the aprun command even when using all nodes 
This commit was SVN r25004.
 2011-08-06 04:19:41 +00:00
Ralph Castain
bd8e43a2de Correct debug output so it doesn't falsely report the module 
This commit was SVN r25003.
 2011-08-05 20:30:34 +00:00
Ralph Castain
d603c79ab4 Fix the FAILED_TO_START scenario so orted doesn't segfault 
This commit was SVN r25002.
 2011-08-05 20:29:50 +00:00
Ralph Castain
c86bfb4e90 Need to copy the string 
This commit was SVN r25001.
 2011-08-05 19:03:28 +00:00
Ralph Castain
7b307d5bf0 Cleanup handling of all-numerical node names 
This commit was SVN r25000.
 2011-08-05 14:59:14 +00:00
Ralph Castain
157bad5435 If we can't compress the name, that's fine - but still have to move to next posn 
This commit was SVN r24999.
 2011-08-05 14:43:36 +00:00
Ralph Castain
3199663613 Correctly handle the case of mixes of character-based names and all-number names 
This commit was SVN r24998.
 2011-08-05 14:37:36 +00:00
Ralph Castain
066022126e Sort the nodes to be in numerically increasing order so the regex has a chance of working right. 
This commit was SVN r24993.
 2011-08-05 03:37:13 +00:00
Ralph Castain
5a634caad9 Cleanly handle the case where the node "name" is just a number, and avoid the N-N output when the number is not part of a sequence. 
This commit was SVN r24992.
 2011-08-05 03:36:30 +00:00
Jeff Squyres
294e1f50cd Remove compiler warning about nested comment 
This commit was SVN r24984.
 2011-08-03 18:30:56 +00:00
Wesley Bland
87a96da99c Should fix some of the shutdown woes of the errmgr. 
Correctly checks that the orted's job is completed.
Correctly tests to make sure that there is shutdown going on (doesn't rely on orte_orteds_term_ordered).
Adds a patch from Ralph to correctdly check the status of processes.

This commit was SVN r24962.
 2011-08-01 14:00:41 +00:00
Ralph Castain
42b125ef35 Move the debug so it more accurately reports 
This commit was SVN r24961.
 2011-07-29 20:48:46 +00:00
Ralph Castain
70bca4691f Add a new "sensor" module that supports fault tolerance tests - randomly kills local procs and/or the daemon itself 
This commit was SVN r24960.
 2011-07-29 20:48:22 +00:00
Wesley Bland
5fde3e0e00 Move the resilient orte errmgr code into a seperate errmgr for now while it's 
still unstable. Reverted errmgr modules back to the original errmgr (with the
updates since the resilient code was brought into the trunk).

This commit was SVN r24958.
 2011-07-28 21:24:34 +00:00
Ralph Castain
6c879f87fb Add a new param "orte_remote_tmpdir_base" for those situations where the compute nodes require a different session directory head than the head node. 
This commit was SVN r24956.
 2011-07-27 19:37:17 +00:00
Ralph Castain
decab98fb2 Do a little better job of catching up on missed mcast messages, and provide a way out of scenarios where catch-up is impossible. 
This commit was SVN r24955.
 2011-07-27 14:58:30 +00:00
Ralph Castain
c3bc33b3fb Don't be so restrictive - accept "slots" as well as "slot" in rank file 
This commit was SVN r24954.
 2011-07-27 00:45:30 +00:00
Wesley Bland
b972fd84e1 No longer sends extra FAILED_NOTIFICATION messages in the non-failure case. 
Should reduce finalize complexity and avoid a race condition that has been
detected by a few users.

This commit was SVN r24952.
 2011-07-26 20:47:44 +00:00
Ralph Castain
715f871605 Ignore the daemon job when reporting parseable output 
This commit was SVN r24944.
 2011-07-25 20:44:08 +00:00
Ralph Castain
db193555c2 Use non-blocking sends for recovering from lost multicast messages 
This commit was SVN r24943.
 2011-07-25 18:49:47 +00:00
Ralph Castain
199804fc35 complete implementation of parseable output 
This commit was SVN r24929.
 2011-07-23 22:23:24 +00:00
Ralph Castain
ffe6f5f40e Fix map pack/unpack so they match 
This commit was SVN r24928.
 2011-07-23 22:23:05 +00:00
Ralph Castain
00647fa342 Update orte-ps to add parseable output - not fully tested because I couldn't get other parts of the system to work. 
This commit was SVN r24927.
 2011-07-23 20:20:31 +00:00
Ralph Castain
869024f1c6 You have to initialize th daemon param -before- using it to get epoch!! 
This commit was SVN r24926.
 2011-07-23 20:19:43 +00:00
Ralph Castain
361bcef253 Close multicast before rml 
This commit was SVN r24925.
 2011-07-23 20:19:15 +00:00
Shiqing Fan
cc4403a863 Remove two unused windows files. 
This commit was SVN r24913.
 2011-07-21 12:53:32 +00:00
Brian Barrett
3bd66a5932 * Remove unused Portals3.3 reference implementation support 
This commit was SVN r24906.
 2011-07-20 23:30:29 +00:00
Eugene Loh
921852e1e5 Clean up the computations of num_procs_alive. Do some code 
refactoring to improve readability and to compute num_procs_alive
correctly and to remove the use of loop iteration variables for
two loops nested one inside another (causing MPI_Comm_spawn_multiple
to fail).

This commit was SVN r24903.
 2011-07-14 20:10:48 +00:00
Ralph Castain
8853e0e80a Fix regular expression analyzer for slurmd - use a slurm-specific version 
Fix multi-node routing for daemon startup when static ports are not set

This commit was SVN r24898.
 2011-07-13 22:49:56 +00:00
Ralph Castain
8d1b31b887 Don't know how we got away with this for so long, but we really shouldn't be referencing pointer array objects directly. 
Also, fix an error in mpirx debugger module - the pointer array object is the pointer to the object itself, not the object "super" like in an opal_list.

This commit was SVN r24894.
 2011-07-13 20:11:14 +00:00
Ralph Castain
1405bacd85 Ensure we dont segfault if we report an error 
This commit was SVN r24890.
 2011-07-13 15:00:22 +00:00
Jeff Squyres
3893a5a1de Fix compile error introduced in r24888. 
This commit was SVN r24889.

The following SVN revision numbers were found above:
  r24888 --> open-mpi/ompi@e5253647ea
 2011-07-13 14:18:00 +00:00
Shiqing Fan
e5253647ea Fix a type cast. 
This commit was SVN r24888.
 2011-07-13 09:00:17 +00:00
Ralph Castain
1ad110d2e9 After a nice, calm, rational discussion between Brian, Jeff, and myself, we decided to revert r24864 and r24862 to restore the reference counters in opal_init/finalize. The rationale was that we should instead change orte_init/finalize to also use reference counters to support multi-embedded libraries. Jeff and Brian will discuss proposing a similar change to mpi_init/finalize to the MPI Forum so that all three libraries will behave in similar manners. 
It was agreed that opal_init_util had wound up being used in unintended ways, which raised the problem of getting reference counts to work right. However, fixing it would involve more pain than it was worth - and so long as the other layers are made to behave similarly, I have no preference either way.

Complete implementation will follow - for now, this just reverts the prior changes.

This commit was SVN r24886.

The following SVN revision numbers were found above:
  r24862 --> open-mpi/ompi@aa92e0c4eb
  r24864 --> open-mpi/ompi@a5062385c2
 2011-07-12 17:07:41 +00:00
Nathan Hjelm
3f4e5d7dd6 add missing thread lock/unlock around condition_broadcast 
This commit was SVN r24885.
 2011-07-12 15:43:56 +00:00
Nathan Hjelm
c3ec2e2614 fix a potential race condition in rml 
This commit was SVN r24884.
 2011-07-12 15:43:12 +00:00
Abhishek Kulkarni
6bf02d1344 Fixes (after the new ORTE resiliency layer was merged) to make the trunk build with C/R flags turned on. 
This commit was SVN r24872.
 2011-07-10 23:36:26 +00:00
Ralph Castain
a5062385c2 Fix singletons 
This commit was SVN r24864.
 2011-07-08 14:38:33 +00:00
Jeff Squyres
3affb8403e Remove extra output 
This commit was SVN r24863.
 2011-07-08 13:01:30 +00:00
Ralph Castain
aa92e0c4eb Replace a useless counter with a boolean check to see if we have already passed thru opal_finalize so we don't call finalize, and then don't pass thru it (as was happening on several tools) 
This commit was SVN r24862.
 2011-07-08 06:43:19 +00:00
Ralph Castain
05f4926bfe Remove some remaining cruft re regular expressions - caused the trunk to fail if regex wasn't being used 
This commit was SVN r24861.
 2011-07-08 06:42:12 +00:00
Ralph Castain
1ee7c39982 Fix some major bit-rot on scalable launch. If static ports are provided, then daemons can connect back to the HNP via the routed connection tree instead of doing so directly. In order to do that at scale, the node list must be passed as a regular expression - otherwise, the orted command line gets too long. 
Over the course of time, usage of static ports got corrupted in several places, the "parent" info got incorrectly reset, etc. So correct all that and get the regex-based wireup going again.

Also, don't pass node lists if static ports aren't enabled - they are of no value to the orted and just create the possibility of overly-long cmd lines.

This commit was SVN r24860.
 2011-07-07 18:54:30 +00:00
Ralph Castain
6496b2f845 Ensure we terminate properly on non-zero exit status 
This commit was SVN r24859.
 2011-07-07 14:33:49 +00:00
Wesley Bland
0628963506 Fix a return code when a process isn't found. 
This commit was SVN r24845.
 2011-06-30 15:22:54 +00:00
Brian Barrett
e52fef28ca Do something rational for the disable full support case 
This commit was SVN r24844.
 2011-06-30 14:48:19 +00:00
Ralph Castain
8ac35a8496 Fully enable the monitoring of memory usage and automatic termination of memory hogs when limits are reached. Improve the efficiency of the sensor system so we don't multiply sample the resource usage if multiple modules are active. Ensure we output the proc error summary when we abnormally terminate. 
This commit was SVN r24843.
 2011-06-30 14:11:56 +00:00
Ralph Castain
c449871ade Add an mca param to set the "fork agent" - i.e., a program to be run when forking off a process (e.g., valgrind). While you could specify this by "mpirun -n N fork_agent ./my_app", not everyone launches procs with ORTE from mpirun. 
Provide the ability to store recent stat histories using the ring_buffer class

This commit was SVN r24842.
 2011-06-30 03:12:38 +00:00
Ralph Castain
2e1fa3e08e Don't error out if the recv.cancel comes back not found as this is just a race condition 
This commit was SVN r24841.
 2011-06-30 01:19:50 +00:00
Ralph Castain
418229c71c Define a new error constant 
This commit was SVN r24833.
 2011-06-28 19:47:16 +00:00
Wesley Bland
84be81df95 Standardize the initialization of the EPOCH's. 
Everyone will be starting at MIN anyway (until we implement restart of course)
so there's no reason to set the epoch to INVALID and then immediately reset them
to MIN. This way there's less room to make mistakes later.

This commit was SVN r24829.
 2011-06-28 14:20:33 +00:00
Ralph Castain
c203eee223 Since process names now have three fields, be sure to initialize all three of them 
This commit was SVN r24828.
 2011-06-27 20:50:08 +00:00
Ralph Castain
d316701d3c Remove unnecessary mcast channel 
This commit was SVN r24816.
 2011-06-23 20:44:22 +00:00
Wesley Bland
e1ba09ad51 Add a resilience to ORTE. Allows the runtime to continue after a process (or 
ORTED) failure. Note that more work will be necessary to allow the MPI layer to
take advantage of this.

Per RFC:
http://www.open-mpi.org/community/lists/devel/2011/06/9299.php

This commit was SVN r24815.
 2011-06-23 20:38:02 +00:00
Ralph Castain
391074cde6 Add a tag 
This commit was SVN r24813.
 2011-06-23 15:12:25 +00:00
Ralph Castain
afceaaa8e4 Add support for detecting rapid failures so the errmgr can respond accordingly 
This commit was SVN r24796.
 2011-06-21 16:08:41 +00:00
Samuel Gutierrez
81f38b258a commit of new shared memory backing facility framework (shmem) and its components. 
This commit was SVN r24795.
 2011-06-21 15:41:57 +00:00
Ralph Castain
9491fbb60c Remove two stale modules 
This commit was SVN r24794.
 2011-06-21 05:57:39 +00:00
Ralph Castain
b95ede99d5 Ensure we use the pmi grpcomm when using pmi 
This commit was SVN r24793.
 2011-06-20 21:57:47 +00:00
Ralph Castain
92a65f21bf Restore slurm pmi support from long, long ago. Since we already have the ability to directly srun an MPI job, just conditionally add the PMI support for key values and provide a grpcomm module that uses PMI for barriers and modex. 
Currently ompi_ignored, and unignored only for me (others to soon follow).

This commit was SVN r24792.
 2011-06-20 21:04:46 +00:00
Jeff Squyres
9531e205e1 Minor fix to a comment 
This commit was SVN r24789.
 2011-06-20 17:51:01 +00:00
Ralph Castain
d563e58348 Remove another lingering bproc reference 
This commit was SVN r24785.
 2011-06-17 18:01:23 +00:00
Ralph Castain
042ee3ec48 Support the option of outputting error_log messages with something other than the process name 
This commit was SVN r24784.
 2011-06-17 14:50:00 +00:00
Ralph Castain
61dd7f4588 Need to pass identification of input/output channels 
This commit was SVN r24783.
 2011-06-17 14:48:59 +00:00
Ralph Castain
93dcfc15d0 Let the upper layer set the channels to be opened 
This commit was SVN r24779.
 2011-06-16 20:31:52 +00:00
Ralph Castain
7f2d2e3de7 Track the app_context rank - will equal overall rank for single app_context jobs 
This commit was SVN r24778.
 2011-06-16 20:31:30 +00:00
Josh Hursey
0eb3b3b7b0 Fix missing functionality in MPI_Abort so that the group of peers defined by the communicator that should be aborted with this process are requested from the runtime before the local process exits. 
Per RFC:
  http://www.open-mpi.org/community/lists/devel/2011/06/9335.php

This commit was SVN r24775.
 2011-06-15 13:10:13 +00:00
Ralph Castain
033cbbed31 Don't automatically assign group channels if not given - let the layer above figure it out. 
This commit was SVN r24771.
 2011-06-10 16:28:18 +00:00
Ralph Castain
e039c7b7ea Avoid crashing when debugging rmaps and a non-string resource constraint is given 
This commit was SVN r24770.
 2011-06-10 16:27:30 +00:00
Josh Hursey
6539a31b23 Cleanup configure checks for C/R functionality. 
Add a WANT_FT_CR flag different from WANT_FT so tools like *-checkpoint are not built when a different FT technique is requested.

Also fix the C/R thread check so that it is only enabled if C/R is enabled, not generally when threads are enabled.

This commit was SVN r24769.
 2011-06-09 19:45:29 +00:00
Josh Hursey
9080eaedf3 Fully initialize the orte_errmgr_base_component_t structure for the app. 
This commit was SVN r24765.
 2011-06-09 14:22:25 +00:00
Josh Hursey
20339a7900 Minor coding style and intentation fixes. 
This commit was SVN r24764.
 2011-06-09 14:16:06 +00:00
Ralph Castain
fc8d920c56 Dont monitor resource usage unless requested, even if sensors are enabled during configure 
This commit was SVN r24760.
 2011-06-08 10:47:25 +00:00
Ralph Castain
906eb925f1 Update the resource usage sensor to initiate support for time analysis of measurements 
This commit was SVN r24759.
 2011-06-07 23:22:51 +00:00
Ralph Castain
f3cae3d6f3 Cleanup the handling of if_include and if_exclude arguments based on CIDR notation. 
Fix a bug in the new code that prevented the system from correctly matching addresses.

Remove comments in the show-help text indicating that we would continue in the face of incorrect specifications - leave that to the calling layer to decide.

Modify the new opal_ifmatches so it returns error codes letting the caller better understand the result.

Modify the oob to ensure we abort if we don't find interfaces matching specified constraints, and that we do so without multiple error messages.

NOTE: we have a conflict in our standards. We have been using comma-delimited lists of interfaces for all our params. However, one param - opal_net_private_ipv4 - now uses semicolons instead of comma separators. No idea why, but it is confusing.

This commit was SVN r24755.
 2011-06-07 02:09:11 +00:00
George Bosilca
6b52d8f519 The paffinity is apparently needed. 
This commit was SVN r24749.
 2011-06-06 01:20:01 +00:00
Ralph Castain
bd8d9a943a Add diagnostics 
This commit was SVN r24748.
 2011-06-05 19:17:56 +00:00
Ralph Castain
1491d52bd7 Extend the parsing capability of the oob tcp module's if_include and if_exclude options to support subnet+mask notation, and to handle virtual IP addresses (it was previously having problems distinguishing between "eth1" and "eth1.3"). 
This commit was SVN r24747.
 2011-06-05 19:16:42 +00:00
George Bosilca
454519842e Report bindings if requested. 
This commit was SVN r24743.
 2011-06-02 17:17:10 +00:00
George Bosilca
1eccadbd87 No need for the paffinity here. 
This commit was SVN r24742.
 2011-06-02 17:16:25 +00:00
Ralph Castain
8f401a0563 Enable the ability to constrain applications to hosts on the basis of resources. 
This commit was SVN r24736.
 2011-05-28 22:18:19 +00:00
Brian Barrett
beb1bc70b2 * Add support for using modex to exchange NID/PID pairs when using Portals4. 
Rather than try to support a bunch of lightweight environments like I did
  with the Portals3 code, always use the "modex" and hack the grpcomm for
  the SHMEM implementation to return the right nid/pid for a remote
  process by "magic".

This commit was SVN r24733.
 2011-05-25 22:10:27 +00:00
Ralph Castain
81b6c50daa Correct stale typo 
This commit was SVN r24725.
 2011-05-23 17:34:22 +00:00
Ralph Castain
661f508e62 Fix typo 
This commit was SVN r24723.
 2011-05-22 00:20:42 +00:00
Ralph Castain
b2331113a5 Add some debug 
This commit was SVN r24722.
 2011-05-21 21:09:47 +00:00
Ralph Castain
8c08ee9c3d Remove stale tool 
This commit was SVN r24720.
 2011-05-21 00:38:35 +00:00
Ralph Castain
1b5ca323c6 Always followup with sigkill when killing local procs as procs can trap sigterm and get stuck 
This commit was SVN r24719.
 2011-05-20 22:40:10 +00:00
Ralph Castain
c5686ecfca Dont sample stats for pid=0 children 
This commit was SVN r24717.
 2011-05-20 14:33:23 +00:00
Ralph Castain
b03e4481a3 Plug a couple of additional places in case orte_iof is not opened 
This commit was SVN r24716.
 2011-05-20 13:42:53 +00:00
Ralph Castain
dc0bb0571b Record the number of heartbeats recvd each period for diag purposes 
This commit was SVN r24714.
 2011-05-20 00:21:33 +00:00
Ralph Castain
69dce0ec10 Minor heartbeat cleanups 
This commit was SVN r24713.
 2011-05-19 21:27:44 +00:00
Ralph Castain
c3df95dd13 Prevent failure due to race condition during abnormal term 
This commit was SVN r24712.
 2011-05-19 21:27:05 +00:00
Ralph Castain
b0f47e6f59 Allow orte_iof to not be opened 
This commit was SVN r24711.
 2011-05-19 21:26:30 +00:00
Ralph Castain
1f3911cc8b Add a new proc state 
This commit was SVN r24710.
 2011-05-19 21:25:58 +00:00
Ralph Castain
b47ec2ee87 Remove lingering references to opal_profile option 
This commit was SVN r24709.
 2011-05-18 18:27:29 +00:00
Ralph Castain
9678e62613 Fix possible corruption of environ. Thanks to Ariel Burton and Peter Thompson for finding it! 
This commit was SVN r24708.
 2011-05-18 16:25:35 +00:00
Ralph Castain
d34bab541d Remove the ompi-profiler tool and its attendant ompi-probe program. Also remove the grpcomm basic component since its only function was to support profiled clusters, which nobody was doing. :-( 
This commit was SVN r24704.
 2011-05-17 03:30:25 +00:00
Ralph Castain
a3e43594a4 Extend node stats to include additional memory info. Change "darwin" pstat module to "test" as we don't really know how to get all the stat info for darwin. 
Add a new OPAL_ERROR_LOG macro similar to the ORTE_ERROR_LOG one.

This commit was SVN r24692.
 2011-05-08 14:45:16 +00:00
Ralph Castain
c160f5d5a2 Add ability to specify mcast interfaces by name 
This commit was SVN r24691.
 2011-05-08 14:42:48 +00:00
Thomas Herault
fb3fd8fd0e items belonging to peer_send_queue are mca_oob_tcp_msg_t *, which are obtained through a opal_freelist. 
They shouldn't be released, but returned to the freelist.

This commit was SVN r24679.
 2011-05-03 21:03:09 +00:00
Ralph Castain
9df207aa51 Fix the case where a user supplies the -xterm option, which requires that we leave ssh sessions attached. 
This commit was SVN r24668.
 2011-05-02 12:39:55 +00:00
Ralph Castain
138928fcf4 Use ports as multicast channels instead of networks so we avoid stepping into reserved spaces. 
This commit was SVN r24666.
 2011-04-29 18:46:40 +00:00
Shiqing Fan
9e90ade864 Missed one file from the last commit. 
This commit was SVN r24664.
 2011-04-29 14:44:02 +00:00
Shiqing Fan
4490fdbd34 Add the initial support for MinGW and MSYS. 
Correctly check the dependencies of MSYS env.
Set up configure include and lib path for building the package.
update a few more CMake scripts.

This commit was SVN r24663.
 2011-04-29 14:42:07 +00:00
Ralph Castain
c78531ce8a Don't free the envar that gets putenv'd as that messes up the environ 
This commit was SVN r24660.
 2011-04-29 08:50:29 +00:00
Ralph Castain
0ff0d20e72 Grr...get the prefix right - need to strip the bin out of absolute path to mpirun. 
This commit was SVN r24658.
 2011-04-28 22:20:55 +00:00
Ralph Castain
6af2677fb8 Check for both absolute-path-to-mpirun and -prefix being specified. If the two differ, print out a warning and ignore -prefix. If they are the same, or only one was given, then proceed as directed. 
This commit was SVN r24657.
 2011-04-28 22:12:41 +00:00
Ralph Castain
b586f2952e Arggg...revert r24645. I knew those fields were there for a reason...sigh. 
This commit was SVN r24647.

The following SVN revision numbers were found above:
  r24645 --> open-mpi/ompi@e4732110da
 2011-04-28 15:07:00 +00:00
Ralph Castain
859aaab93d In the case of direct-launched processes running under slurm, psm requires that the pre_condition_transports MCA param be set. This is normally computed by mpirun and inserted into each proc's environ, but that doesn't work here. 
So separate out the printing of that key, and let the individual procs generate it in a way that ensures they all get the same result.

This commit was SVN r24646.
 2011-04-28 13:54:33 +00:00
Ralph Castain
e4732110da Remove a couple more stale fields 
This commit was SVN r24645.
 2011-04-28 00:26:38 +00:00
Ralph Castain
39369f8807 Remove stale fields from global objects - have been moved to the layer that actually uses them 
This commit was SVN r24644.
 2011-04-28 00:20:49 +00:00
Ralph Castain
8858d9a40e Add a marker for other layers to use in defining data types 
This commit was SVN r24643.
 2011-04-28 00:19:35 +00:00
Ralph Castain
9988b97b97 Extend/update how we handle process stats. Add the ability to collect node-level stats separate from the process stats. Update the process stat memory fields to report in MBytes instead of KBytes as I can't find any process that runs in KBytes nowadays. 
Rename the memusage sensor plugin to "resusage" as it will soon be updated to include full process stat monitoring.

Extend the heartbeat sensor to report node and process stats in the heartbeat.

Store the process and node stats in their respective orte_xxx_t object.

This commit was SVN r24629.
 2011-04-21 22:55:45 +00:00
Ralph Castain
5f64b830f9 Ensure we only kill threads once 
This commit was SVN r24620.
 2011-04-18 14:47:09 +00:00
Ralph Castain
8014e7432c Send recovery defined flag in app_contexts, include recovery flags in debug prints 
This commit was SVN r24619.
 2011-04-18 14:46:42 +00:00
Ralph Castain
89501e6e24 Don't try to politely end threads when abnormally terminating as we can hang if the thread is in a stuck callback. 
This commit was SVN r24618.
 2011-04-18 12:21:47 +00:00
Ralph Castain
3a28556472 Expand our handling of non-zero exit status. If a process exits with non-zero status, pass that info along to the user in case it means something to them, even if the process also exited without calling MPI_Finalize. If the process calls MPI_Abort, that trumps the exit status question. 
Provide a new MCA param that allows the user to direct that we abort the job once a process exits with non-zero status. No recovery is allowed in such cases to avoid trying to restart a process that has already exited MPI.

This commit was SVN r24614.
 2011-04-14 15:04:21 +00:00
Ralph Castain
30fb002524 Take the first small step towards rationalizing rsh support. Create a new "rshbase" component that contains a simple rsh module - no tree spawn, uses all the base functions for launch support. Extend the base rsh support functions to include those functions in common across all rsh modules. 
Only a minor change made to the current rsh module to avoid a naming conflict. Otherwise, left it alone to avoid creating conflicts with other external work. The current rsh module remains the default for rsh/ssh support, and continues to contain the support for SGE and Loadleveler.

This commit was SVN r24593.
 2011-03-30 01:15:07 +00:00
Nysal Jan
866ae8b43a Close the file descriptor 
This commit was SVN r24580.
 2011-03-29 08:42:49 +00:00
Nysal Jan
c8c6b0edab Improve LoadLeveler integration with Open MPI. Add support for LL native rsh agent - llspawn 
This commit was SVN r24579.
 2011-03-29 07:46:59 +00:00
Nathan Hjelm
8634b6394f fixed plm/tm component 
This commit was SVN r24577.
 2011-03-25 22:20:15 +00:00
Ralph Castain
d7e029cb40 Convert heartbeat to multicast basis 
This commit was SVN r24570.
 2011-03-24 19:05:39 +00:00
Ralph Castain
90698a2c02 Ensure that blocking recvs wait until the data is actually recvd 
This commit was SVN r24558.
 2011-03-22 18:45:54 +00:00
Ralph Castain
888472f671 Do not release recv as the calling function needs that data and will release it later 
This commit was SVN r24557.
 2011-03-22 18:44:56 +00:00
Ralph Castain
30981de200 Minor cleanups courtesy of Nysal - thanks! 
This commit was SVN r24552.
 2011-03-22 13:48:58 +00:00
Ralph Castain
c1396b278c Resolve the rsh confusion by splitting the initial search for a launch agent from the actual setup of the launch agent values in the plm base globals. Have each aspiring rsh-clone call lookup to see if their desired launch agent is available - if not, then reject that plm component. 
If so, then setup the actual launch agent values only when the module init function is called.

This resolves the current conflict between the rsh and rshd components. Hopefully, it may avoid future problems in this area -provided- any new uses of rsh-like launchers abide by the lookup-and-then-setup rule.

This commit was SVN r24550.
 2011-03-22 02:23:09 +00:00
Ralph Castain
d17b50e1ff Add the appropriate hooks to tell Totalview to display the user's main program upon startup. Apparently, this hook got lost somewhere after the 1.2 series :-( 
Thanks to David Turner and the TV folks for passing this along.

This commit was SVN r24549.
 2011-03-21 17:40:58 +00:00
Ralph Castain
795ca2cff2 Complete implementation of the multicast-based grpcomm module 
This commit was SVN r24548.
 2011-03-20 01:18:06 +00:00
Ralph Castain
fa40f5d7c3 Fix bad formatting 
This commit was SVN r24547.
 2011-03-20 01:17:29 +00:00
Ralph Castain
281116ddc5 A max_restarts value of -1 is now valid and indicates infinite restarts, so correct the validity check 
This commit was SVN r24546.
 2011-03-20 01:17:00 +00:00
Eugene Loh
2770a12beb Continue clean up of thread options started in r22841, 22842, and 22849. 
No need for any CMRs to 1.5... that was already done in CMR 2728.

This commit was SVN r24545.

The following SVN revision numbers were found above:
  r22841 --> open-mpi/ompi@b400b84162
 2011-03-18 21:36:35 +00:00
Ralph Castain
ee68cd102c Fix the hier grpcomm module so modex results in correct data. The prior implementation stored the modex data as node-based attributes. This worked fine for BTL's such as openib where the interfaces were associated with the node. However, BTL's such as TCP have interfaces associated with a specific process, not a node. Thus, store the data in the modex database so it is correctly indexed. 
This commit was SVN r24536.
 2011-03-17 02:22:23 +00:00
Ralph Castain
d5dfe05521 Remove stale code associated with OPAL_THREADS_HAVE_DIFFERENT_PIDS. In the past, we have supported the case of really, really old Linux kernels where threads have different pids. However, when we updated the event library, we didn't also update that support code. In addition, when we dropped progress thread support, we didn't remove areas of the code that could no longer be compiled (i.e., were protected by "if progress thread && if have different pids). 
There was no compelling reason to support such old kernels. Accordingly, convert the test to print a nice error message indicating we no longer support old kernels (but indicate that earlier OMPI versions do) and error out. Remove all code that was protected by "if have different pids" since it can no longer be compiled.

This commit was SVN r24531.
 2011-03-15 21:05:03 +00:00
Ralph Castain
de092af8ef Add a little more debug 
This commit was SVN r24526.
 2011-03-14 18:43:49 +00:00
Ralph Castain
ebabe9c83a Forgot that Terry wanted to control the vm launch with an mca param - set one up for that purpose 
This commit was SVN r24525.
 2011-03-13 00:46:42 +00:00
Ralph Castain
dc6f616599 Enable VM launch. 
For some time, ORTE has had the ability to launch daemons on all nodes prior to launching an application. It has largely been used outside of the OMPI community, and so was never explicitly turned "on" inside OMPI releases. Nevertheless, the code has been there.

Allowing VM launches does not require ANY changes to existing PLM components. All that was required was to have orterun launch the daemons as a separate call to orte_plm.spawn -prior- to launching the applications. The rest of the VM support code resides in the rmaps framework:

(a) a check when asked to map a job to see if it is the daemon job, and

(b) a separate "setup_virtual_machine" mapper in the rmaps base that creates the required map so the PLM's will do the right thing.

In order to support those users who have no RM allocation but like to give the allocation in the form of a -host or -hostfile argument to their application, there is a little more code in orterun and the setup_virtual_machine mapper to capture information passed in that manner.

This has been tested with rsh and slurm environments, and, since there is nothing environment-specific in the implementation, should work in others as well - but needs to be proven.

This commit was SVN r24524.
 2011-03-12 22:50:53 +00:00
Ralph Castain
80265b472e Avoid direct reference of pointer_array elements 
This commit was SVN r24523.
 2011-03-12 20:18:51 +00:00
Ralph Castain
df82e4cd36 Plug a memory leak 
This commit was SVN r24521.
 2011-03-12 15:37:33 +00:00
Ralph Castain
1297acde13 George raised some valid concerns about the extensibility of the revised rmaps framework. Address those by: 
1. removing the enum of mapper values

2. change the req_mapper and last_mapper fields to char* so they can hold the component name instead of a mapper flag

3. revise the selection logic in the mapper components to reflect the change. Components now look for their name in the req_mapper field, or to see if other criteria (e.g., npernode) are set that mandate their doing the mapping

Several MCA params resided in the rmaps base for historical reasons - they have been in the base since at least the original 1.2 release (and perhaps earlier). However, George correctly pointed out that they really should reside in their respective components. Accordingly, move them to the components, but register synonyms to the old names to avoid breaking backward compatibility.

These revisions retain the current functionality of allowing comm_spawn'd jobs to use different mappers than the original job, and for the errmgr to utilize the resilient mapper to recover processes regardless of how they were originally mapped.

Given the large number of possible combinations, I am sure that someone will find a corner-case combination of values and selection criteria that cause either no mapper to be selected, or one other than the intended to be used. No one can test all the ways people will use this system, so I expect debugging to continue for awhile.

The ability of comm_spawn'd jobs to exploit this functionality relies on changes to the orte_dpm component - this will be committed separately.

This commit was SVN r24520.
 2011-03-12 05:30:09 +00:00
Samuel Gutierrez
830c7c66dc fixes CID #1667 
This commit was SVN r24518.
 2011-03-12 03:09:01 +00:00
Ralph Castain
e6a76cc923 Fixes CID #1954 
This commit was SVN r24516.
 2011-03-11 23:00:27 +00:00
Ralph Castain
2ccd514b9a Add version string to app 
This commit was SVN r24514.
 2011-03-11 20:38:37 +00:00
Samuel Gutierrez
2a2319d23a when orte_timing is enabled, always record daemon launch start time before starting the real work. 
This commit was SVN r24513.
 2011-03-11 00:09:23 +00:00
Ralph Castain
f9a9fac76b Minor typo 
This commit was SVN r24506.
 2011-03-10 16:09:31 +00:00
George Bosilca
80fe617cd2 If we don't release the OPAL utils explicitly there will be a memory leak. 
This commit was SVN r24505.
 2011-03-10 00:42:28 +00:00
George Bosilca
7f34a28c8f Correct a comment. 
This commit was SVN r24504.
 2011-03-10 00:41:41 +00:00
George Bosilca
d2502b14f9 Destruct the OOB TCP internal objects. 
This commit was SVN r24503.
 2011-03-10 00:40:54 +00:00
Ralph Castain
3b4421d8e3 Separately track requested and last-used mapper so we don't lose that info 
This commit was SVN r24502.
 2011-03-09 18:51:36 +00:00
Jeff Squyres
06d5c59115 Fix a few valgrind-reported memory leaks 
This commit was SVN r24498.
 2011-03-08 17:37:28 +00:00
Jeff Squyres
0586612bd5 Fix another minor memory leak 
This commit was SVN r24495.
 2011-03-08 15:46:13 +00:00
Jeff Squyres
79cf382ff3 Fix a few issues with error messages: 
* If something goes wrong during ompi_mpi_init, don't erroneously
   report that it is illegal to invoke MPI_INIT* before MPI_INIT
 * Aggregate help messages when possible when something goes wring
   during ompi_mpi_init

This commit was SVN r24492.
 2011-03-07 16:45:45 +00:00
Ralph Castain
63f38e38bb Fix ompi-server: remove extra command flag in buffer being sent to mpirun, ensure that tools route messages thru a remote HNP 
This commit was SVN r24491.
 2011-03-05 17:12:46 +00:00
Ralph Castain
d764e7a398 We want uid/gid support at the individual application level. Ensure the values get initialized and packed/unpacked for transfer. 
This commit was SVN r24489.
 2011-03-04 18:46:43 +00:00
George Bosilca
9bbe00bdc3 Set the return code from the processes upstream. 
This commit was SVN r24483.
 2011-03-03 00:02:21 +00:00
George Bosilca
c6a5f9706a Thomas's patch: Assume we won't fail unless notified by a child. 
This commit was SVN r24482.
 2011-03-02 23:50:01 +00:00