openmpi/orte/mca/odls/base/Makefile.am

#
# Copyright (c) 2004-2007 The Trustees of Indiana University and Indiana
#                         University Research and Technology
#                         Corporation.  All rights reserved.
# Copyright (c) 2004-2005 The University of Tennessee and The University
#                         of Tennessee Research Foundation.  All rights
#                         reserved.
# Copyright (c) 2004-2005 High Performance Computing Center Stuttgart, 
#                         University of Stuttgart.  All rights reserved.
# Copyright (c) 2004-2005 The Regents of the University of California.
#                         All rights reserved.
# $COPYRIGHT$
# 
# Additional copyrights may follow
# 
# $HEADER$
#

dist_pkgdata_DATA += base/help-orte-odls-base.txt

headers += \
        base/odls_private.h \
        base/base.h

libmca_odls_la_SOURCES += \
        base/odls_base_close.c \
        base/odls_base_default_fns.c \
        base/odls_base_open.c \
        base/odls_base_select.c \
        base/odls_base_state.c
The new bproc launcher. This is divided into 2 parts, bproc which does the frontend work and bproc_orted which sets up io for the processes on the backend. The launcher is fairly complete and has been tested on fairly large jobs. However, the finalization is not done so right now it just blocks in finalize. This commit was SVN r6085. 2005-06-17 21:12:50 +00:00			`#`
Bring over the jjh-filem branch which contains a non-blocking FileM interface and implementation. This has shown drastic performance benefit when transferring Many files at roughly the same time. I tested this for many different filem operations and everything was working fine. Let me know if you have any problems with this functionality. Some Notes: - opal-checkpoint now has a 'quiet' flag to keep it from being too verbose. - FileM RSH component is fully non-blocking. - FileM RSH component has incomming connection throttling since by default ssh only allows 10 concurrent scp connections to any single host. This default can be adjusted via an MCA parameter. {{{-mca filem_rsh_max_incomming 10}}} - There is an MCA parameter for max outgoing connections, but it is currently not implemented. If someone needs it then it should not be hard to implement. {{{-mca filem_rsh_max_outgoing 10}}} - Changed the FileM request structure so that it is a bit more explicit and flexible. - Moved the 'preload-binary' and 'preload-files' functionality into odls/base allowing for code reuse in the 'process' and 'default' ODLS components. - Fixed a bug in the process name resolution which broke the 'preload-*' functionality due to GPR table structure changes. - The FileM RSH component might be able to see even more speedup from using a thread pool to operate on the work_pool structures, but that is for future work. - Added a 'opal-show-help' file to ODLS Base This commit was SVN r16252. 2007-09-27 13:13:29 +00:00			`# Copyright (c) 2004-2007 The Trustees of Indiana University and Indiana`
Update the copyright notices for IU and UTK. This commit was SVN r7999. 2005-11-05 19:57:48 +00:00			`# University Research and Technology`
			`# Corporation. All rights reserved.`
			`# Copyright (c) 2004-2005 The University of Tennessee and The University`
			`# of Tennessee Research Foundation. All rights`
			`# reserved.`
The new bproc launcher. This is divided into 2 parts, bproc which does the frontend work and bproc_orted which sets up io for the processes on the backend. The launcher is fairly complete and has been tested on fairly large jobs. However, the finalization is not done so right now it just blocks in finalize. This commit was SVN r6085. 2005-06-17 21:12:50 +00:00			`# Copyright (c) 2004-2005 High Performance Computing Center Stuttgart,`
			`# University of Stuttgart. All rights reserved.`
			`# Copyright (c) 2004-2005 The Regents of the University of California.`
			`# All rights reserved.`
			`# $COPYRIGHT$`
			`#`
			`# Additional copyrights may follow`
			`#`
			`# $HEADER$`
			`#`

Bring over the jjh-filem branch which contains a non-blocking FileM interface and implementation. This has shown drastic performance benefit when transferring Many files at roughly the same time. I tested this for many different filem operations and everything was working fine. Let me know if you have any problems with this functionality. Some Notes: - opal-checkpoint now has a 'quiet' flag to keep it from being too verbose. - FileM RSH component is fully non-blocking. - FileM RSH component has incomming connection throttling since by default ssh only allows 10 concurrent scp connections to any single host. This default can be adjusted via an MCA parameter. {{{-mca filem_rsh_max_incomming 10}}} - There is an MCA parameter for max outgoing connections, but it is currently not implemented. If someone needs it then it should not be hard to implement. {{{-mca filem_rsh_max_outgoing 10}}} - Changed the FileM request structure so that it is a bit more explicit and flexible. - Moved the 'preload-binary' and 'preload-files' functionality into odls/base allowing for code reuse in the 'process' and 'default' ODLS components. - Fixed a bug in the process name resolution which broke the 'preload-*' functionality due to GPR table structure changes. - The FileM RSH component might be able to see even more speedup from using a thread pool to operate on the work_pool structures, but that is for future work. - Added a 'opal-show-help' file to ODLS Base This commit was SVN r16252. 2007-09-27 13:13:29 +00:00			`dist_pkgdata_DATA += base/help-orte-odls-base.txt`

Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661. 2006-09-14 21:29:51 +00:00			`headers += \`
			`base/odls_private.h \`
			`base/base.h`
The new bproc launcher. This is divided into 2 parts, bproc which does the frontend work and bproc_orted which sets up io for the processes on the backend. The launcher is fairly complete and has been tested on fairly large jobs. However, the finalization is not done so right now it just blocks in finalize. This commit was SVN r6085. 2005-06-17 21:12:50 +00:00
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661. 2006-09-14 21:29:51 +00:00			`libmca_odls_la_SOURCES += \`
			`base/odls_base_close.c \`
Reorganize the odls framework to place common functionality in the base, thus making maintenance easier. We still need this to be a framework as some environments (e.g., bproc) require significantly different functionality. However, there is quite a bit of commonality across the components, so this ensures that fixes in one get propagated across the others. This patch also fixes a minor bug discovered along the way: we had "lost" the passing of the oversubscribed condition flag from the mapper to the orteds. Thus, we were not setting sched_yield correctly when in oversubscribed conditions (except when a hostfile was specified - different logic there because we treat the number of slots allocated on the node as "uncertain") I did not modify the process component in this patch - I will send a proposed patch to the maintainers of that component so they can review it first. This commit was SVN r16418. 2007-10-10 15:02:10 +00:00			`base/odls_base_default_fns.c \`
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661. 2006-09-14 21:29:51 +00:00			`base/odls_base_open.c \`
			`base/odls_base_select.c \`
Merge the ORTE devel branch into the main trunk. Details of what this means will be circulated separately. Remains to be tested to ensure everything came over cleanly, so please continue to withhold commits a little longer This commit was SVN r17632. 2008-02-28 01:57:57 +00:00			`base/odls_base_state.c`