ports/openmpi
ports/openmpi
1
1
Форкнуть 0
Код Релизы Активность
cd87c8ad41
openmpi/orte/util/Makefile.am

84 строки
2.7 KiB
Makefile
Исходник Обычный вид История

First cut at Makefile.am's for orte This commit was SVN r6280.
2005-07-02 18:36:36 +04:00
#
Update the copyright notices for IU and UTK. This commit was SVN r7999.
2005-11-05 22:57:48 +03:00
# Copyright (c) 2004-2005 The Trustees of Indiana University and Indiana
# University Research and Technology
# Corporation. All rights reserved.
# Copyright (c) 2004-2005 The University of Tennessee and The University
# of Tennessee Research Foundation. All rights
# reserved.
Purge whitespace from the repo
2015-06-24 06:59:57 +03:00
# Copyright (c) 2004-2005 High Performance Computing Center Stuttgart,
First cut at Makefile.am's for orte This commit was SVN r6280.
2005-07-02 18:36:36 +04:00
# University of Stuttgart. All rights reserved.
# Copyright (c) 2004-2005 The Regents of the University of California.
# All rights reserved.
More fixes for #1387. Minor fixes for the orte_host.7 man page file that was missed in the inital pass. We are using $(am_dirstamp) instead of creating our own dirstamp since there is src code in util/hostfile directory is created. The automake process creates the $(am_dirstamp), we found the use of this in the generated Makefile in the util/Makefile This commit was SVN r19230.
2008-08-08 23:10:02 +04:00
# Copyright (c) 2008 Sun Microsystems, Inc. All rights reserved.
Per RFC: http://www.open-mpi.org/community/lists/devel/2014/05/14822.php Revamp the ORTE global data structures to reduce memory footprint and add new features. Add ability to control/set cpu frequency, though this can only be done if the sys admin has setup the system to support it (or you run as root). This commit was SVN r31916.
2014-06-01 20:14:10 +04:00
# Copyright (c) 2014 Cisco Systems, Inc. All rights reserved.
Fat SMPs (i.e., systems with nodes containing large numbers of cpus) were failing to start due to connection failures of the opal/pmix support. Root cause was that (a) we were setting the client socket to non-blocking before calling connect, and (b) the server was using the event library to harvest the accepts, and also did the handshake while in that event. So the server would backup beyond the connection backlog limit, and we would fail. Changing the client to leave its socket as blocking during the connect doesn't solve the problem by itself - you also have to introduce a sleep delay once the backlog is hit to avoid simply machine-gunning your way thru retries. This gets somewhat difficult to adjust as you don't want to unnecessarily prolong startup time. We've solved this before by adding a listening thread that simply reaps accepts and shoves them into the event library for subsequent processing. This would resolve the problem, but meant yet another daemon-level thread. So I centralized the listening thread support and let multiple elements register listeners on it. Thus, each daemon now has a single listening thread that reaps accepts from multiple sources - for now, the orte/pmix server and the oob/usock support are using it. I'll add in the oob/tcp component later. This still didn't fully resolve the SMP problem, especially on coprocessor cards (e.g., KNC). Removing the shared memory dstore support helped further improve the behavior - it looks like there is some kind of memory paging issue there that needs further understanding. Given that the shared memory support was about to be lost when I bring over the PMIx integration (until it is restored in that library), it seemed like a reasonable thing to just remove it at this point.
2015-05-30 00:28:26 +03:00
# Copyright (c) 2014-2015 Intel, Inc. All rights reserved.
First cut at Makefile.am's for orte This commit was SVN r6280.
2005-07-02 18:36:36 +04:00
# $COPYRIGHT$
Purge whitespace from the repo
2015-06-24 06:59:57 +03:00
#
First cut at Makefile.am's for orte This commit was SVN r6280.
2005-07-02 18:36:36 +04:00
# Additional copyrights may follow
Purge whitespace from the repo
2015-06-24 06:59:57 +03:00
#
First cut at Makefile.am's for orte This commit was SVN r6280.
2005-07-02 18:36:36 +04:00
# $HEADER$
#
The next in a long line of crazed build system changes from Brian. This was originally suggested by Ralf Wildenhues, to try to speed autogen, configure, and make (and possibly even make install). Use automake's include directive to drastically reduce the number of Makefile files (although the number of Makefile.am files is the same - most are just included in a top-level Makefile.am). Also use an Automake SUBDIRs feature to eliminate the dynamic-mca tree, which was no longer really needed. This makes adding a framework easier (since you don't have to remember the dynamic-mca tree) and makes building faster (as make doesn't have to recurse through the dynamic-mca tree) This commit was SVN r7777.
2005-10-17 04:21:10 +04:00
# This makefile.am does not stand on its own - it is included from orte/Makefile.am
build: add Automake-like silent/verbose macros for "ln -s ..." operations Also, since I put some of the macros for these silent/verbose rules up in the top-level Makefile.man-page-rules file, I renamed it to Makefile.ompi-rules. I've had this sitting around for a while; now seems like as good a time as any to commit it. This commit was SVN r31271.
2014-03-28 22:24:32 +04:00
include $(top_srcdir)/Makefile.ompi-rules
More fixes for #1387. Minor fixes for the orte_host.7 man page file that was missed in the inital pass. We are using $(am_dirstamp) instead of creating our own dirstamp since there is src code in util/hostfile directory is created. The automake process creates the $(am_dirstamp), we found the use of this in the generated Makefile in the util/Makefile This commit was SVN r19230.
2008-08-08 23:10:02 +04:00
Use the correct abstraction layer name for the data dirs This commit was SVN r31684.
2014-05-08 18:32:24 +04:00
dist_ortedata_DATA += util/hostfile/help-hostfile.txt \
Add a central capability to parse regular expressions for node and ppn info - constructing the regex to come soon. This commit was SVN r20596.
2009-02-19 23:46:36 +03:00
util/dash_host/help-dash-host.txt \
util/help-regex.txt
Update the manpages for comm_spawn(_multiple) - add man page to explain host/hostfile behavior This commit was SVN r18961.
2008-07-21 21:58:12 +04:00
More fixes for #1387. Minor fixes for the orte_host.7 man page file that was missed in the inital pass. We are using $(am_dirstamp) instead of creating our own dirstamp since there is src code in util/hostfile directory is created. The automake process creates the $(am_dirstamp), we found the use of this in the generated Makefile in the util/Makefile This commit was SVN r19230.
2008-08-08 23:10:02 +04:00
nodist_man_MANS = util/hostfile/orte_hosts.7
# We are using $(am_dirstamp) instead of creating our own dirstamp since there
# is src code in util/hostfile directory is created. The automake process
# creates the $(am_dirstamp), we found the use of this in the generated Makefile
# in the util/Makefile
$(nodist_man_MANS): util/hostfile/$(am__dirstamp) $(top_builddir)/opal/include/opal_config.h
Update the manpages for comm_spawn(_multiple) - add man page to explain host/hostfile behavior This commit was SVN r18961.
2008-07-21 21:58:12 +04:00
Crumby - get the make tarball correct! Earlier commit was from intermediate state... This commit was SVN r20504.
2009-02-10 21:33:32 +03:00
EXTRA_DIST += $(nodist_man_MANS:.7=.7in)
Merge the ORTE devel branch into the main trunk. Details of what this means will be circulated separately. Remains to be tested to ensure everything came over cleanly, so please continue to withhold commits a little longer This commit was SVN r17632.
2008-02-28 04:57:57 +03:00
AM_LFLAGS = -Porte_util_hostfile_
LEX_OUTPUT_ROOT = lex.orte_util_hostfile_
The next in a long line of crazed build system changes from Brian. This was originally suggested by Ralf Wildenhues, to try to speed autogen, configure, and make (and possibly even make install). Use automake's include directive to drastically reduce the number of Makefile files (although the number of Makefile.am files is the same - most are just included in a top-level Makefile.am). Also use an Automake SUBDIRs feature to eliminate the dynamic-mca tree, which was no longer really needed. This makes adding a framework easier (since you don't have to remember the dynamic-mca tree) and makes building faster (as make doesn't have to recurse through the dynamic-mca tree) This commit was SVN r7777.
2005-10-17 04:21:10 +04:00
headers += \
Merge the ORTE devel branch into the main trunk. Details of what this means will be circulated separately. Remains to be tested to ensure everything came over cleanly, so please continue to withhold commits a little longer This commit was SVN r17632.
2008-02-28 04:57:57 +03:00
util/name_fns.h \
The next in a long line of crazed build system changes from Brian. This was originally suggested by Ralf Wildenhues, to try to speed autogen, configure, and make (and possibly even make install). Use automake's include directive to drastically reduce the number of Makefile files (although the number of Makefile.am files is the same - most are just included in a top-level Makefile.am). Also use an Automake SUBDIRs feature to eliminate the dynamic-mca tree, which was no longer really needed. This makes adding a framework easier (since you don't have to remember the dynamic-mca tree) and makes building faster (as make doesn't have to recurse through the dynamic-mca tree) This commit was SVN r7777.
2005-10-17 04:21:10 +04:00
util/proc_info.h \
util/session_dir.h \
Revamp the errmgr framework to provide a greater range of optional behaviors, including different behaviors for daemons, and remove several looping messages across the code base: * add hnp and orted modules to the errmgr framework. The HNP module contains much of the code that was in the errmgr base since that code could only be executed by the HNP anyway. * update the odls to report process states directly into the active errmgr module, thus removing the need to send messages looped back into the odls cmd processor. Let the active errmgr module decide what to do at various states. * remove the code to track application state progress from the plm_base_launch_support.c code. Update the plm modules to call the errmgr directly when a launch fails. * update the plm_base_receive.c code to call the errmgr with state updates from remote daemons * update the routed modules to reflect that process state is updated in the errmgr * ensure that the orted's open the errmgr and select their appropriate module * add new pretty-print utilities to print process and job state. Move the pretty-print of time info to a globally-accessible place * define a global orte_comm function to send messages from orted's to the HNP so that others can overlay the standard RML methods, if desired. * update the orterun help output to reflect that the "term w/o sync" error message can result from three, not two, scenarios This commit was SVN r23023.
2010-04-23 08:44:41 +04:00
util/show_help.h \
Remove the old configure option for disabling full rte support - we now use the OMPI rte framework for such purposes This commit was SVN r28134.
2013-02-28 05:35:55 +04:00
util/error_strings.h \
Complete implementation of the --without-rte-support configure option. Working with Brian, this has been tested on RedStorm. Some minor changes to help facilitate debugger support so that both mpirun and yod can operate with it. Still to be completed. This commit was SVN r18664.
2008-06-18 07:15:56 +04:00
util/context_fns.h \
Since parsing comma-delimited, range-capable options is being used in multiple places, create a new utility that consolidates that code. Have orte-iof use it. This commit was SVN r20346.
2009-01-25 20:16:25 +03:00
util/parse_options.h \
Complete implementation of the --without-rte-support configure option. Working with Brian, this has been tested on RedStorm. Some minor changes to help facilitate debugger support so that both mpirun and yod can operate with it. Still to be completed. This commit was SVN r18664.
2008-06-18 07:15:56 +04:00
util/pre_condition_transports.h \
Merge the ORTE devel branch into the main trunk. Details of what this means will be circulated separately. Remains to be tested to ensure everything came over cleanly, so please continue to withhold commits a little longer This commit was SVN r17632.
2008-02-28 04:57:57 +03:00
util/hnp_contact.h \
util/hostfile/hostfile.h \
util/hostfile/hostfile_lex.h \
util/dash_host/dash_host.h \
Fold in the revised modex scheme. Move the ompi_proc_t modex portions to the RTE level since the daemons already have that info. Provide each process with the equivalent of a "nidmap" - both a map of what nodes are in the job, and a map of which node each process is on. This enables the use of static ports, though that hasn't been turned "on" in this commit. Update the rsh tree spawn capability so we spawn the next wave of daemons before launching our own local procs. Add an ability to encode nodenames for large clusters with contiguous node name numbering schemes - this allows communication of all node names in a few bytes instead of tens-of-bytes/node. This commit was SVN r18338.
2008-04-30 23:49:53 +04:00
util/comm/comm.h \
Add a central capability to parse regular expressions for node and ppn info - constructing the regex to come soon. This commit was SVN r20596.
2009-02-19 23:46:36 +03:00
util/nidmap.h \
Per RFC: http://www.open-mpi.org/community/lists/devel/2014/05/14822.php Revamp the ORTE global data structures to reduce memory footprint and add new features. Add ability to control/set cpu frequency, though this can only be done if the sys admin has setup the system to support it (or you run as root). This commit was SVN r31916.
2014-06-01 20:14:10 +04:00
util/regex.h \
Fat SMPs (i.e., systems with nodes containing large numbers of cpus) were failing to start due to connection failures of the opal/pmix support. Root cause was that (a) we were setting the client socket to non-blocking before calling connect, and (b) the server was using the event library to harvest the accepts, and also did the handshake while in that event. So the server would backup beyond the connection backlog limit, and we would fail. Changing the client to leave its socket as blocking during the connect doesn't solve the problem by itself - you also have to introduce a sleep delay once the backlog is hit to avoid simply machine-gunning your way thru retries. This gets somewhat difficult to adjust as you don't want to unnecessarily prolong startup time. We've solved this before by adding a listening thread that simply reaps accepts and shoves them into the event library for subsequent processing. This would resolve the problem, but meant yet another daemon-level thread. So I centralized the listening thread support and let multiple elements register listeners on it. Thus, each daemon now has a single listening thread that reaps accepts from multiple sources - for now, the orte/pmix server and the oob/usock support are using it. I'll add in the oob/tcp component later. This still didn't fully resolve the SMP problem, especially on coprocessor cards (e.g., KNC). Removing the shared memory dstore support helped further improve the behavior - it looks like there is some kind of memory paging issue there that needs further understanding. Given that the shared memory support was about to be lost when I bring over the PMIx integration (until it is restored in that library), it seemed like a reasonable thing to just remove it at this point.
2015-05-30 00:28:26 +03:00
util/attr.h \
util/listener.h
The next in a long line of crazed build system changes from Brian. This was originally suggested by Ralf Wildenhues, to try to speed autogen, configure, and make (and possibly even make install). Use automake's include directive to drastically reduce the number of Makefile files (although the number of Makefile.am files is the same - most are just included in a top-level Makefile.am). Also use an Automake SUBDIRs feature to eliminate the dynamic-mca tree, which was no longer really needed. This makes adding a framework easier (since you don't have to remember the dynamic-mca tree) and makes building faster (as make doesn't have to recurse through the dynamic-mca tree) This commit was SVN r7777.
2005-10-17 04:21:10 +04:00
configury: new OPAL_SET_LIB_PREFIX/ORTE_SET_LIB_PREFIX macros These two macros set the prefix for the OPAL and ORTE libraries, respectively. Specifically, the OPAL library will be named libPREFIXopen-pal.la and the ORTE library will be named libPREFIXopen-rte.la. These macros must be called, even if the prefix argument is empty. The intent is that Open MPI will call these macros with an empty prefix, but other projects (such as ORCM) will call these macros with a non-empty prefix. For example, ORCM libraries can be named liborcm-open-pal.la and liborcm-open-rte.la. This scheme is necessary to allow running Open MPI applications under systems that use their own versions of ORTE and OPAL. For example, when running MPI applications under ORTE, if the ORTE and OPAL libraries between OMPI and ORCM are not identical (which, because they are released at different times, are likely to be different), we need to ensure that the OMPI applications link against their ORTE and OPAL libraries, but the ORCM executables link against their ORTE and OPAL libraries.
2014-10-22 16:49:58 +04:00
lib@ORTE_LIB_PREFIX@open_rte_la_SOURCES += \
Remove the old configure option for disabling full rte support - we now use the OMPI rte framework for such purposes This commit was SVN r28134.
2013-02-28 05:35:55 +04:00
util/error_strings.c \
util/name_fns.c \
util/proc_info.c \
util/session_dir.c \
util/show_help.c \
Merge the ORTE devel branch into the main trunk. Details of what this means will be circulated separately. Remains to be tested to ensure everything came over cleanly, so please continue to withhold commits a little longer This commit was SVN r17632.
2008-02-28 04:57:57 +03:00
util/context_fns.c \
Since parsing comma-delimited, range-capable options is being used in multiple places, create a new utility that consolidates that code. Have orte-iof use it. This commit was SVN r20346.
2009-01-25 20:16:25 +03:00
util/parse_options.c \
Push a generated "key" out to all the processes. This is necessary for some interconnect wireup in which all processes must agree on a "key" to initialize the interconnect with. This commit was SVN r11653.
2006-09-14 19:27:17 +04:00
util/pre_condition_transports.c \
Merge the ORTE devel branch into the main trunk. Details of what this means will be circulated separately. Remains to be tested to ensure everything came over cleanly, so please continue to withhold commits a little longer This commit was SVN r17632.
2008-02-28 04:57:57 +03:00
util/hnp_contact.c \
util/hostfile/hostfile_lex.l \
util/hostfile/hostfile.c \
util/dash_host/dash_host.c \
Fold in the revised modex scheme. Move the ompi_proc_t modex portions to the RTE level since the daemons already have that info. Provide each process with the equivalent of a "nidmap" - both a map of what nodes are in the job, and a map of which node each process is on. This enables the use of static ports, though that hasn't been turned "on" in this commit. Update the rsh tree spawn capability so we spawn the next wave of daemons before launching our own local procs. Add an ability to encode nodenames for large clusters with contiguous node name numbering schemes - this allows communication of all node names in a few bytes instead of tens-of-bytes/node. This commit was SVN r18338.
2008-04-30 23:49:53 +04:00
util/comm/comm.c \
Add a central capability to parse regular expressions for node and ppn info - constructing the regex to come soon. This commit was SVN r20596.
2009-02-19 23:46:36 +03:00
util/nidmap.c \
Per RFC: http://www.open-mpi.org/community/lists/devel/2014/05/14822.php Revamp the ORTE global data structures to reduce memory footprint and add new features. Add ability to control/set cpu frequency, though this can only be done if the sys admin has setup the system to support it (or you run as root). This commit was SVN r31916.
2014-06-01 20:14:10 +04:00
util/regex.c \
Fat SMPs (i.e., systems with nodes containing large numbers of cpus) were failing to start due to connection failures of the opal/pmix support. Root cause was that (a) we were setting the client socket to non-blocking before calling connect, and (b) the server was using the event library to harvest the accepts, and also did the handshake while in that event. So the server would backup beyond the connection backlog limit, and we would fail. Changing the client to leave its socket as blocking during the connect doesn't solve the problem by itself - you also have to introduce a sleep delay once the backlog is hit to avoid simply machine-gunning your way thru retries. This gets somewhat difficult to adjust as you don't want to unnecessarily prolong startup time. We've solved this before by adding a listening thread that simply reaps accepts and shoves them into the event library for subsequent processing. This would resolve the problem, but meant yet another daemon-level thread. So I centralized the listening thread support and let multiple elements register listeners on it. Thus, each daemon now has a single listening thread that reaps accepts from multiple sources - for now, the orte/pmix server and the oob/usock support are using it. I'll add in the oob/tcp component later. This still didn't fully resolve the SMP problem, especially on coprocessor cards (e.g., KNC). Removing the shared memory dstore support helped further improve the behavior - it looks like there is some kind of memory paging issue there that needs further understanding. Given that the shared memory support was about to be lost when I bring over the PMIx integration (until it is restored in that library), it seemed like a reasonable thing to just remove it at this point.
2015-05-30 00:28:26 +03:00
util/attr.c \
util/listener.c
Add a central capability to parse regular expressions for node and ppn info - constructing the regex to come soon. This commit was SVN r20596.
2009-02-19 23:46:36 +03:00
More fixes for #1387. Minor fixes for the orte_host.7 man page file that was missed in the inital pass. We are using $(am_dirstamp) instead of creating our own dirstamp since there is src code in util/hostfile directory is created. The automake process creates the $(am_dirstamp), we found the use of this in the generated Makefile in the util/Makefile This commit was SVN r19230.
2008-08-08 23:10:02 +04:00
# Remove the generated man pages
distclean-local:
rm -f $(nodist_man_MANS)
Копировать постоянную ссылку