1
1
openmpi/opal
Josh Hursey e10f476c87 Bring over the jjh-filem branch which contains a non-blocking FileM interface
and implementation. This has shown drastic performance benefit when
transferring Many files at roughly the same time.

I tested this for many different filem operations and everything was working
fine. Let me know if you have any problems with this functionality.

Some Notes:
 - opal-checkpoint now has a 'quiet' flag to keep it from being too verbose.

 - FileM RSH component is fully non-blocking.

 - FileM RSH component has incomming connection throttling since by default
   ssh only allows 10 concurrent scp connections to any single host. This
   default can be adjusted via an MCA parameter.
    {{{-mca filem_rsh_max_incomming 10}}}

 - There is an MCA parameter for max outgoing connections, but it is currently
   not implemented. If someone needs it then it should not be hard to implement.
    {{{-mca filem_rsh_max_outgoing 10}}}

 - Changed the FileM request structure so that it is a bit more explicit and
   flexible.

 - Moved the 'preload-binary' and 'preload-files' functionality into odls/base
   allowing for code reuse in the 'process' and 'default' ODLS components.

 - Fixed a bug in the process name resolution which broke the 'preload-*'
   functionality due to GPR table structure changes.

 - The FileM RSH component might be able to see even more speedup from using a
   thread pool to operate on the work_pool structures, but that is for future
   work.

 - Added a 'opal-show-help' file to ODLS Base

This commit was SVN r16252.
2007-09-27 13:13:29 +00:00
..
asm remove unneeded footer 2006-09-26 20:30:49 +00:00
class Fix ABA problem in atomic_lifo code. This is temporary solution for now. We 2007-09-11 15:40:30 +00:00
etc * fix a typo 2007-02-06 21:59:55 +00:00
event If we don't have event ops, we don't have a current_base, so don't dereference 2007-08-07 17:09:54 +00:00
include A number of improvements / changes to the RML/OOB layers: 2007-07-20 01:34:02 +00:00
mca Use secure version of strncpy and srtncat. Release the temporary 2007-09-14 02:04:34 +00:00
memoryhooks Change a bunch of 'OMPI' names to OPAL names, since this is opal. 2007-03-29 01:00:33 +00:00
runtime Few clean-ups, few indentations. Nothing really important. 2007-08-04 00:44:23 +00:00
threads Make non threaded OPAL_ATOMIC_CMPSET macros work correctly. 2007-09-09 08:00:16 +00:00
tools Bring over the jjh-filem branch which contains a non-blocking FileM interface 2007-09-27 13:13:29 +00:00
util Some platforms (such as FreeBSD) need libutil.h included for openpty. 2007-09-19 21:59:22 +00:00
win32 dd some Windows missing defines & macros. 2007-04-01 15:55:34 +00:00
Makefile.am Clean up a couple of configure things: 2007-05-15 04:23:48 +00:00
win_makefile Move all win32 related files in opal, and modify all the Makefiles.am to 2005-12-08 06:17:15 +00:00