ports/openmpi
ports/openmpi
1
1
Форкнуть 0
Код Релизы Активность
openmpi/orte/mca/filem/raw/filem_raw.h

81 строка
1.8 KiB
C
Исходник Обычный вид История

Extend the filem interface to support prepositioning and linking required local files for execution. Create a new "raw" module that uses xcast to send the files to all nodes as this is faster than doing an scp in a linear pattern This commit was SVN r27118.
2012-08-22 21:43:20 +00:00
/*
* Copyright (c) 2012 Los Alamos National Security, LLC.
* All rights reserved
* $COPYRIGHT$
Purge whitespace from the repo
2015-06-23 20:59:57 -07:00
*
Extend the filem interface to support prepositioning and linking required local files for execution. Create a new "raw" module that uses xcast to send the files to all nodes as this is faster than doing an scp in a linear pattern This commit was SVN r27118.
2012-08-22 21:43:20 +00:00
* Additional copyrights may follow
Purge whitespace from the repo
2015-06-23 20:59:57 -07:00
*
Extend the filem interface to support prepositioning and linking required local files for execution. Create a new "raw" module that uses xcast to send the files to all nodes as this is faster than doing an scp in a linear pattern This commit was SVN r27118.
2012-08-22 21:43:20 +00:00
* $HEADER$
*/
#ifndef MCA_FILEM_RAW_EXPORT_H
#define MCA_FILEM_RAW_EXPORT_H
#include "orte_config.h"
MCA: Add the project/project version to the MCA base component This commit adds support for project_framework_component_* parameter matching. This is the first step in allowing the same framework name in multiple projects. This change also bumps the MCA component version to 2.1.0. All master frameworks have been updated to use the new component versioning macro. An mca.h has been added to each project to add a project specific versioning macro of the form PROJECT_MCA_VERSION_2_1_0. Signed-off-by: Nathan Hjelm <hjelmn@me.com>
2015-03-05 20:50:44 -07:00
#include "orte/mca/mca.h"
Extend the filem interface to support prepositioning and linking required local files for execution. Create a new "raw" module that uses xcast to send the files to all nodes as this is faster than doing an scp in a linear pattern This commit was SVN r27118.
2012-08-22 21:43:20 +00:00
#include "opal/class/opal_object.h"
#include "opal/mca/event/event.h"
#include "orte/mca/filem/filem.h"
BEGIN_C_DECLS
ORTE_MODULE_DECLSPEC extern orte_filem_base_component_t mca_filem_raw_component;
ORTE_DECLSPEC extern orte_filem_base_module_t mca_filem_raw_module;
Ensure we don't re-link files when staging execution as we may be executing more members of the same app. Allow the user to ask that directory trees be "flattened" so that all files appear in the proc's session directory itself. This commit was SVN r27232.
2012-09-04 17:52:12 +00:00
extern bool orte_filem_raw_flatten_trees;
Extend the filem interface to support prepositioning and linking required local files for execution. Create a new "raw" module that uses xcast to send the files to all nodes as this is faster than doing an scp in a linear pattern This commit was SVN r27118.
2012-08-22 21:43:20 +00:00
#define ORTE_FILEM_RAW_CHUNK_MAX 16384
/* local classes */
typedef struct {
opal_list_item_t super;
opal_list_t xfers;
int32_t status;
orte_filem_completion_cbfunc_t cbfunc;
void *cbdata;
} orte_filem_raw_outbound_t;
OBJ_CLASS_DECLARATION(orte_filem_raw_outbound_t);
typedef struct {
opal_list_item_t super;
orte_filem_raw_outbound_t *outbound;
Since the preload flags are at the app_context level, we need to link only those files/exe's that pertain to each app_context to the corresponding procs. Also, gain a little optimization by checking to ensure we only send files once - this probably won't work when daemons are created on-the-fly, but that's for some other day This commit was SVN r27134.
2012-08-24 16:16:30 +00:00
orte_app_idx_t app_idx;
Extend the filem interface to support prepositioning and linking required local files for execution. Create a new "raw" module that uses xcast to send the files to all nodes as this is faster than doing an scp in a linear pattern This commit was SVN r27118.
2012-08-22 21:43:20 +00:00
opal_event_t ev;
bool pending;
Since the preload flags are at the app_context level, we need to link only those files/exe's that pertain to each app_context to the corresponding procs. Also, gain a little optimization by checking to ensure we only send files once - this probably won't work when daemons are created on-the-fly, but that's for some other day This commit was SVN r27134.
2012-08-24 16:16:30 +00:00
char *src;
Extend the filem interface to support prepositioning and linking required local files for execution. Create a new "raw" module that uses xcast to send the files to all nodes as this is faster than doing an scp in a linear pattern This commit was SVN r27118.
2012-08-22 21:43:20 +00:00
char *file;
int32_t type;
int32_t nchunk;
int status;
orte_vpid_t nrecvd;
} orte_filem_raw_xfer_t;
OBJ_CLASS_DECLARATION(orte_filem_raw_xfer_t);
typedef struct {
opal_list_item_t super;
Since the preload flags are at the app_context level, we need to link only those files/exe's that pertain to each app_context to the corresponding procs. Also, gain a little optimization by checking to ensure we only send files once - this probably won't work when daemons are created on-the-fly, but that's for some other day This commit was SVN r27134.
2012-08-24 16:16:30 +00:00
orte_app_idx_t app_idx;
Extend the filem interface to support prepositioning and linking required local files for execution. Create a new "raw" module that uses xcast to send the files to all nodes as this is faster than doing an scp in a linear pattern This commit was SVN r27118.
2012-08-22 21:43:20 +00:00
opal_event_t ev;
bool pending;
int fd;
char *file;
char *top;
char *fullpath;
int32_t type;
Support archives .tar, .bz[2,zip], and .gz[ip] This commit was SVN r27123.
2012-08-23 15:38:39 +00:00
char **link_pts;
Extend the filem interface to support prepositioning and linking required local files for execution. Create a new "raw" module that uses xcast to send the files to all nodes as this is faster than doing an scp in a linear pattern This commit was SVN r27118.
2012-08-22 21:43:20 +00:00
opal_list_t outputs;
} orte_filem_raw_incoming_t;
OBJ_CLASS_DECLARATION(orte_filem_raw_incoming_t);
typedef struct {
opal_list_item_t super;
int numbytes;
unsigned char data[ORTE_FILEM_RAW_CHUNK_MAX];
} orte_filem_raw_output_t;
OBJ_CLASS_DECLARATION(orte_filem_raw_output_t);
END_C_DECLS
#endif /* MCA_FILEM_RAW_EXPORT_H */
Копировать постоянную ссылку