ports/openmpi
ports/openmpi
1
1
Форкнуть 0
Код Релизы Активность
openmpi/orte/mca/pls/cnos/pls_cnos.c

137 строки
3.5 KiB
C
Исходник Обычный вид История

Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
/*
* Copyright (c) 2004-2006 The Trustees of Indiana University and Indiana
* University Research and Technology
* Corporation. All rights reserved.
* Copyright (c) 2004-2005 The University of Tennessee and The University
* of Tennessee Research Foundation. All rights
* reserved.
* Copyright (c) 2004-2005 High Performance Computing Center Stuttgart,
* University of Stuttgart. All rights reserved.
* $COPYRIGHT$
*
* Additional copyrights may follow
*
* $HEADER$
*/
#include "orte_config.h"
#include <stdlib.h>
#include <errno.h>
#ifdef HAVE_UNISTD_H
#include <unistd.h>
#endif /* HAVE_UNISTD_H */
#ifdef HAVE_STRING_H
#include <string.h>
#endif /* HAVE_STRING_H */
#ifdef HAVE_SIGNAL_H
#include <signal.h>
#endif
Bring over the rest of the ctrl-c fixes. This commit includes: 1. add a "cancel_operation" API to the pls components that allows orterun to demand that an orted operation (e.g., terminate_job) be immediately cancelled and abandoned. 2. changes the pls orted commands from blocking to non-blocking. This allows us to interrupt those operations should an orted be non-responsive. The change also adds an orte_abort_timeout that limits how long orterun will automatically wait for the orteds to respond - if the terminate command, for example, doesn't see orted response within that time, then we printout an appropriate error message and just give up. 3. modifies orterun to allow multiple ctrl-c's to simply abort the program even if the orteds have not responded 4. does some cleanup on the orte-level mca params so that their implementation looks a lot more like that of ompi - makes it easier to maintain. This change also includes the definition of an orte_abort_timeout struct and associated MCA param (can't have too many!) so you can set the time after which orterun gives up on waiting for orteds to respond This needs more testing before migrating to 1.2. This commit was SVN r13304.
2007-01-25 14:17:44 +00:00
#ifdef HAVE_SYS_TIME_H
#include <sys/time.h>
#endif
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
#ifdef HAVE_CNOS_PM_BARRIER
#include <catamount/cnos_mpi_os.h>
#endif
#include "orte/orte_constants.h"
#include "orte/mca/rmgr/base/base.h"
#include "orte/mca/ns/ns.h"
#include "orte/util/proc_info.h"
#include "pls_cnos.h"
static int orte_pls_cnos_launch_job(orte_jobid_t jobid);
Bring over the rest of the ctrl-c fixes. This commit includes: 1. add a "cancel_operation" API to the pls components that allows orterun to demand that an orted operation (e.g., terminate_job) be immediately cancelled and abandoned. 2. changes the pls orted commands from blocking to non-blocking. This allows us to interrupt those operations should an orted be non-responsive. The change also adds an orte_abort_timeout that limits how long orterun will automatically wait for the orteds to respond - if the terminate command, for example, doesn't see orted response within that time, then we printout an appropriate error message and just give up. 3. modifies orterun to allow multiple ctrl-c's to simply abort the program even if the orteds have not responded 4. does some cleanup on the orte-level mca params so that their implementation looks a lot more like that of ompi - makes it easier to maintain. This change also includes the definition of an orte_abort_timeout struct and associated MCA param (can't have too many!) so you can set the time after which orterun gives up on waiting for orteds to respond This needs more testing before migrating to 1.2. This commit was SVN r13304.
2007-01-25 14:17:44 +00:00
static int orte_pls_cnos_terminate_job(orte_jobid_t jobid, struct timeval *timeout, opal_list_t *attrs);
Complete modifications for failed-to-start of applications. Modifications for failed-to-start of orteds coming next. This completes the minor changes required to the PLS components. Basically, there is a small change required to the parameter list of the orted cmd functions. I caught and did it for xcpu and poe, in addition to the components listed in my email - so I think that only leaves xgrid unconverted. The orted fail-to-start mods will also make changes in the PLS components, but those can be localized so they come in one at a time. This commit was SVN r14499.
2007-04-24 20:53:54 +00:00
static int orte_pls_cnos_terminate_orteds(struct timeval *timeout, opal_list_t *attrs);
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
static int orte_pls_cnos_terminate_proc(const orte_process_name_t* proc_name);
Bring over the update to terminate orteds that are generated by a dynamic spawn such as comm_spawn. This introduces the concept of a job "family" - i.e., jobs that have a parent/child relationship. Comm_spawn'ed jobs have a parent (the one that spawned them). We track that relationship throughout the lineage - i.e., if a comm_spawned job in turn calls comm_spawn, then it has a parent (the one that spawned it) and a "root" job (the original job that started things). Accordingly, there are new APIs to the name service to support the ability to get a job's parent, root, immediate children, and all its descendants. In addition, the terminate_job, terminate_orted, and signal_job APIs for the PLS have been modified to accept attributes that define the extent of their actions. For example, doing a "terminate_job" with an attribute of ORTE_NS_INCLUDE_DESCENDANTS will terminate the given jobid AND all jobs that descended from it. I have tested this capability on a MacBook under rsh, Odin under SLURM, and LANL's Flash (bproc). It worked successfully on non-MPI jobs (both simple and including a spawn), and MPI jobs (again, both simple and with a spawn). This commit was SVN r12597.
2006-11-14 19:34:59 +00:00
static int orte_pls_cnos_signal_job(orte_jobid_t jobid, int32_t signal, opal_list_t *attrs);
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
static int orte_pls_cnos_signal_proc(const orte_process_name_t* proc_name, int32_t signal);
static int orte_pls_cnos_finalize(void);
orte_pls_base_module_t orte_pls_cnos_module = {
orte_pls_cnos_launch_job,
orte_pls_cnos_terminate_job,
orte_pls_cnos_terminate_orteds,
orte_pls_cnos_terminate_proc,
orte_pls_cnos_signal_job,
orte_pls_cnos_signal_proc,
orte_pls_cnos_finalize
};
static int orte_pls_cnos_launch_job(orte_jobid_t jobid)
{
return ORTE_ERR_NOT_SUPPORTED;
}
#ifdef HAVE_KILLRANK
#include "catamount/types.h"
/* secret sauce on the Cray machine */
extern int killrank(rank_t RANK, int SIG);
#endif
Bring over the rest of the ctrl-c fixes. This commit includes: 1. add a "cancel_operation" API to the pls components that allows orterun to demand that an orted operation (e.g., terminate_job) be immediately cancelled and abandoned. 2. changes the pls orted commands from blocking to non-blocking. This allows us to interrupt those operations should an orted be non-responsive. The change also adds an orte_abort_timeout that limits how long orterun will automatically wait for the orteds to respond - if the terminate command, for example, doesn't see orted response within that time, then we printout an appropriate error message and just give up. 3. modifies orterun to allow multiple ctrl-c's to simply abort the program even if the orteds have not responded 4. does some cleanup on the orte-level mca params so that their implementation looks a lot more like that of ompi - makes it easier to maintain. This change also includes the definition of an orte_abort_timeout struct and associated MCA param (can't have too many!) so you can set the time after which orterun gives up on waiting for orteds to respond This needs more testing before migrating to 1.2. This commit was SVN r13304.
2007-01-25 14:17:44 +00:00
static int orte_pls_cnos_terminate_job(orte_jobid_t jobid, struct timeval *timeout, opal_list_t *attrs)
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
{
Update the Cray XT3 run-time support files to compile with latest RTE changes This commit was SVN r13172.
2007-01-17 22:47:27 +00:00
orte_jobid_t my_jobid = ORTE_PROC_MY_NAME->jobid;
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
/* make sure it's my job */
if (jobid == my_jobid) {
Update the Cray XT3 run-time support files to compile with latest RTE changes This commit was SVN r13172.
2007-01-17 22:47:27 +00:00
#ifdef HAVE_KILLRANK
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
killrank(-1, SIGKILL);
#else
Update the Cray XT3 run-time support files to compile with latest RTE changes This commit was SVN r13172.
2007-01-17 22:47:27 +00:00
exit(0);
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
#endif
Update the Cray XT3 run-time support files to compile with latest RTE changes This commit was SVN r13172.
2007-01-17 22:47:27 +00:00
}
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
Update the Cray XT3 run-time support files to compile with latest RTE changes This commit was SVN r13172.
2007-01-17 22:47:27 +00:00
return ORTE_ERR_NOT_SUPPORTED;
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
}
Complete modifications for failed-to-start of applications. Modifications for failed-to-start of orteds coming next. This completes the minor changes required to the PLS components. Basically, there is a small change required to the parameter list of the orted cmd functions. I caught and did it for xcpu and poe, in addition to the components listed in my email - so I think that only leaves xgrid unconverted. The orted fail-to-start mods will also make changes in the PLS components, but those can be localized so they come in one at a time. This commit was SVN r14499.
2007-04-24 20:53:54 +00:00
static int orte_pls_cnos_terminate_orteds(struct timeval *timeout, opal_list_t *attrs)
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
{
Update the Cray XT3 run-time support files to compile with latest RTE changes This commit was SVN r13172.
2007-01-17 22:47:27 +00:00
#ifdef HAVE_KILLRANK
Complete modifications for failed-to-start of applications. Modifications for failed-to-start of orteds coming next. This completes the minor changes required to the PLS components. Basically, there is a small change required to the parameter list of the orted cmd functions. I caught and did it for xcpu and poe, in addition to the components listed in my email - so I think that only leaves xgrid unconverted. The orted fail-to-start mods will also make changes in the PLS components, but those can be localized so they come in one at a time. This commit was SVN r14499.
2007-04-24 20:53:54 +00:00
killrank(-1, SIGKILL);
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
#else
Complete modifications for failed-to-start of applications. Modifications for failed-to-start of orteds coming next. This completes the minor changes required to the PLS components. Basically, there is a small change required to the parameter list of the orted cmd functions. I caught and did it for xcpu and poe, in addition to the components listed in my email - so I think that only leaves xgrid unconverted. The orted fail-to-start mods will also make changes in the PLS components, but those can be localized so they come in one at a time. This commit was SVN r14499.
2007-04-24 20:53:54 +00:00
exit(0);
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
#endif
Update the Cray XT3 run-time support files to compile with latest RTE changes This commit was SVN r13172.
2007-01-17 22:47:27 +00:00
return ORTE_ERR_NOT_SUPPORTED;
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
}
static int orte_pls_cnos_terminate_proc(const orte_process_name_t* proc_name)
{
Update the Cray XT3 run-time support files to compile with latest RTE changes This commit was SVN r13172.
2007-01-17 22:47:27 +00:00
orte_jobid_t my_jobid = ORTE_PROC_MY_NAME->jobid;
orte_jobid_t his_jobid = proc_name->jobid;
orte_vpid_t his_vpid = proc_name->vpid;
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
/* make sure it's my job. This may end up killing me, but what
the heck. */
if (his_jobid == my_jobid) {
Update the Cray XT3 run-time support files to compile with latest RTE changes This commit was SVN r13172.
2007-01-17 22:47:27 +00:00
#ifdef HAVE_KILLRANK
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
killrank((int) his_vpid, SIGKILL);
#else
Update the Cray XT3 run-time support files to compile with latest RTE changes This commit was SVN r13172.
2007-01-17 22:47:27 +00:00
exit(0);
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
#endif
Update the Cray XT3 run-time support files to compile with latest RTE changes This commit was SVN r13172.
2007-01-17 22:47:27 +00:00
}
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
Update the Cray XT3 run-time support files to compile with latest RTE changes This commit was SVN r13172.
2007-01-17 22:47:27 +00:00
return ORTE_ERR_NOT_SUPPORTED;
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
}
Bring over the update to terminate orteds that are generated by a dynamic spawn such as comm_spawn. This introduces the concept of a job "family" - i.e., jobs that have a parent/child relationship. Comm_spawn'ed jobs have a parent (the one that spawned them). We track that relationship throughout the lineage - i.e., if a comm_spawned job in turn calls comm_spawn, then it has a parent (the one that spawned it) and a "root" job (the original job that started things). Accordingly, there are new APIs to the name service to support the ability to get a job's parent, root, immediate children, and all its descendants. In addition, the terminate_job, terminate_orted, and signal_job APIs for the PLS have been modified to accept attributes that define the extent of their actions. For example, doing a "terminate_job" with an attribute of ORTE_NS_INCLUDE_DESCENDANTS will terminate the given jobid AND all jobs that descended from it. I have tested this capability on a MacBook under rsh, Odin under SLURM, and LANL's Flash (bproc). It worked successfully on non-MPI jobs (both simple and including a spawn), and MPI jobs (again, both simple and with a spawn). This commit was SVN r12597.
2006-11-14 19:34:59 +00:00
static int orte_pls_cnos_signal_job(orte_jobid_t jobid, int32_t signal, opal_list_t *attrs)
Here is the major MAD-cure commit. I have written plenty about it, so I refer you here to those messages for a description of everything that was done. This commit was SVN r11661.
2006-09-14 21:29:51 +00:00
{
return ORTE_ERR_NOT_SUPPORTED;
}
static int orte_pls_cnos_signal_proc(const orte_process_name_t* proc_name, int32_t signal)
{
return ORTE_ERR_NOT_SUPPORTED;
}
static int orte_pls_cnos_finalize(void)
{
return ORTE_SUCCESS;
}
Копировать постоянную ссылку