Ralph Castain
|
a4b6fb241f
|
Remove all remaining vestiges of the Windows integration
This commit was SVN r28137.
|
2013-02-28 17:31:47 +00:00 |
|
Ralph Castain
|
04304c186f
|
Remove the setup_hadoop configure script as it is no longer required - the hadoop support components can build without accessing hadoop itself.
This commit was SVN r27385.
|
2012-09-29 18:30:35 +00:00 |
|
Ralph Castain
|
e309db0be9
|
Ensure file descriptors are closed upon completion of transfer
This commit was SVN r27349.
|
2012-09-18 18:39:29 +00:00 |
|
Ralph Castain
|
11305109e1
|
Track positioned files so we avoid re-positioning them across jobs
This commit was SVN r27347.
|
2012-09-18 15:56:21 +00:00 |
|
Ralph Castain
|
36acbe4ca6
|
Multiple apps might want the same files, so instead of using the app_idx to determine who gets what, use the actual file names as they are sent anyway
This commit was SVN r27254.
|
2012-09-06 22:02:05 +00:00 |
|
Ralph Castain
|
18d2f75b56
|
Ensure we don't re-link files when staging execution as we may be executing more members of the same app. Allow the user to ask that directory trees be "flattened" so that all files appear in the proc's session directory itself.
This commit was SVN r27232.
|
2012-09-04 17:52:12 +00:00 |
|
Ralph Castain
|
95019cc310
|
Fix a few places where we weren't completely identifying hostfile-based operations against "localhost" entries. Tell the mapper base to be silent when we don't want errors announced because nodes aren't available for mapping (something it is okay if they are fully used). Fix an infinite loop in the file prepositioning code.
This commit was SVN r27210.
|
2012-08-31 21:28:49 +00:00 |
|
Ralph Castain
|
bccc20d13e
|
Deal with one last corner case of positioning a dot-file
This commit was SVN r27144.
|
2012-08-26 03:49:31 +00:00 |
|
Ralph Castain
|
63d41c643d
|
Minor cleanup
This commit was SVN r27143.
|
2012-08-25 14:24:45 +00:00 |
|
Ralph Castain
|
05f0b4c653
|
Couple of minor cleanups
This commit was SVN r27135.
|
2012-08-24 21:14:40 +00:00 |
|
Ralph Castain
|
d6cbff6d4e
|
Since the preload flags are at the app_context level, we need to link only those files/exe's that pertain to each app_context to the corresponding procs. Also, gain a little optimization by checking to ensure we only send files once - this probably won't work when daemons are created on-the-fly, but that's for some other day
This commit was SVN r27134.
|
2012-08-24 16:16:30 +00:00 |
|
Ralph Castain
|
e0c39c94e8
|
Complete the cleanup of the preload files system. Remove the dest_dir option as moving things to arbitrary locations - especially absolute paths - can prove disastrous. Remove the preload_libs option as these can be treated as just files. Cleanup some of the pack/unpack code as the dss handles NULL strings just fine. Deal a little better with absolute paths, noting that tar now strips the leading '/' for us (showing my age as it didn't used to do so).
Remove the odls_base_state.c file as that code is now covered by the new broadcast form of preload_files.
This commit was SVN r27127.
|
2012-08-24 02:28:29 +00:00 |
|
Ralph Castain
|
b4a544ad2a
|
Per discussion with Josh, use the --preload-xxx cmd line options to broadcast files to all nodes. Add --set-cwd-to-session-dir option to start procs in their session directories. Add OMPI_FILE_LOCATION envar to tell procs where their prepositioned files went.
This commit was SVN r27125.
|
2012-08-23 21:28:05 +00:00 |
|
Ralph Castain
|
855c9ae6cf
|
Support archives .tar, .bz[2,zip], and .gz[ip]
This commit was SVN r27123.
|
2012-08-23 15:38:39 +00:00 |
|
Ralph Castain
|
7237a938bf
|
Extend the filem interface to support prepositioning and linking required local files for execution. Create a new "raw" module that uses xcast to send the files to all nodes as this is faster than doing an scp in a linear pattern
This commit was SVN r27118.
|
2012-08-22 21:43:20 +00:00 |
|