1
1
openmpi/orte/mca/odls/process
Josh Hursey e10f476c87 Bring over the jjh-filem branch which contains a non-blocking FileM interface
and implementation. This has shown drastic performance benefit when
transferring Many files at roughly the same time.

I tested this for many different filem operations and everything was working
fine. Let me know if you have any problems with this functionality.

Some Notes:
 - opal-checkpoint now has a 'quiet' flag to keep it from being too verbose.

 - FileM RSH component is fully non-blocking.

 - FileM RSH component has incomming connection throttling since by default
   ssh only allows 10 concurrent scp connections to any single host. This
   default can be adjusted via an MCA parameter.
    {{{-mca filem_rsh_max_incomming 10}}}

 - There is an MCA parameter for max outgoing connections, but it is currently
   not implemented. If someone needs it then it should not be hard to implement.
    {{{-mca filem_rsh_max_outgoing 10}}}

 - Changed the FileM request structure so that it is a bit more explicit and
   flexible.

 - Moved the 'preload-binary' and 'preload-files' functionality into odls/base
   allowing for code reuse in the 'process' and 'default' ODLS components.

 - Fixed a bug in the process name resolution which broke the 'preload-*'
   functionality due to GPR table structure changes.

 - The FileM RSH component might be able to see even more speedup from using a
   thread pool to operate on the work_pool structures, but that is for future
   work.

 - Added a 'opal-show-help' file to ODLS Base

This commit was SVN r16252.
2007-09-27 13:13:29 +00:00
..
.ompi_ignore Rename the Windows component. 2006-10-05 06:32:57 +00:00
configure.m4 Last step for the name reversion (from windows back to process). 2006-10-05 06:36:11 +00:00
configure.params Remove unneeded PARAM_INIT_FILE variable in configure.params files used by 2007-01-08 03:44:22 +00:00
help-odls-process.txt Fix the bug that caused mpirun to hang when a remote executable wasn't found using the rsh launcher. Will now test on a remote node 2006-10-11 18:43:13 +00:00
Makefile.am Just like r14289 on the ORTE trunk: 2007-04-12 11:19:42 +00:00
odls_process_component.c Update the Windows ODLS component. 2007-06-12 22:37:04 +00:00
odls_process_module.c Bring over the jjh-filem branch which contains a non-blocking FileM interface 2007-09-27 13:13:29 +00:00
odls_process.h Update the Windows ODLS component. 2007-06-12 22:37:04 +00:00