Edgar Gabriel
e65e189671
io/ompio: fix file size after file_preallocate
...
Thanks for @dalcini for reporting
Fixes open-mpi/ompi#1633
2016-05-06 08:20:59 -05:00
Edgar Gabriel
d358965134
io/ompio: fix envelope of datatype returned by getview
...
Thanks for @dalcini for reporting
Fixes open-mpi/ompi#1632
2016-05-06 08:19:48 -05:00
Jeff Squyres
f167be1c91
ompio: always return valid info from FILE_GET_INFO
...
MPI-3.1 says that even if no info keys are set on the file, we need to
return a new, empty info.
Thanks to Lisandro Dalcin for identifying the issue.
Fixes open-mpi/ompi#1630
Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
2016-05-05 12:03:29 -07:00
Nathan Hjelm
ae0ffbb67f
Merge pull request #1397 from hjelmn/enable_thread_multiple
...
ompi: always enable MPI_THREAD_MULTIPLE support
2016-04-23 08:40:22 -06:00
Karol Mroz
5c54184986
romio: replace deprecated hindexed call
...
Signed-off-by: Karol Mroz <mroz.karol@gmail.com>
2016-04-10 19:56:22 +02:00
Nathan Hjelm
230d04327e
ompi: always enable MPI_THREAD_MULTIPLE support
...
This commit removes the --with-mpi-thread-multiple option and forces
MPI_THREAD_MULTIPLE support. This cleans up an abstration violation
in opal where OMPI_ENABLE_THREAD_MULTIPLE determines whether the
opal_using_threads is meaningful. To reduce the performance hit on
MPI_THREAD_SINGLE programs an OPAL_UNLIKELY is used for the
check on opal_using_threads in OPAL_THREAD_* macros.
This commit does not clean up the arguments to the various functions
that take whether muti-threading support is enabled. That should be
done at a later time.
Signed-off-by: Nathan Hjelm <hjelmn@lanl.gov>
2016-02-23 10:02:14 -07:00
Edgar Gabriel
4bbb22bd0b
add a new field to the ompio data structure (stripe_count) and set it correctly on pvfs2 and lustre.
2016-01-17 09:48:49 -06:00
Gilles Gouaillardet
fec973efda
configury: test portability
...
replace test ... -o ... with test ... || test ...
and test ... -a ... with test ... && test ...
2015-12-28 13:58:45 +09:00
rhc54
aa17bdf6e8
Merge pull request #1239 from rhc54/topic/cleanup
...
Cleanup the warnings from the ompi layer when compiling optimized under Mac OSX
2015-12-21 07:23:31 -08:00
Edgar Gabriel
46c20a1246
correctly set all variables storing information on the file pointer position to zero when setting the file view
2015-12-21 09:41:39 +09:00
Ralph Castain
ac6289dca6
Cleanup the warnings from the ompi layer when compiling optimized under Mac OSX
...
Cleanup per George's comments
2015-12-17 17:39:15 -08:00
Gilles Gouaillardet
59a361b781
ompio: correctly handle zero f_cc_size in mca_io_ompio_simple_grouping
2015-12-08 17:00:11 +09:00
Edgar Gabriel
9e5ade4e8b
argh, a debugging sleep statement got into the source code.
2015-11-16 13:26:57 -06:00
Edgar Gabriel
dbfbcdecd5
make adjustments for the default settings of grouping parameters and the default contiguous group size option.
...
minor bug fix in the simple grouping strategy.
2015-11-16 08:17:27 -06:00
Edgar Gabriel
27628774c7
add a new option for a simple aggregator selection which has zero communication costs.
2015-11-16 08:17:26 -06:00
Edgar Gabriel
66c1ea5fcb
change the default value of the grouping option. Also add new grouping option which skips the refinement step in the aggregator selection.
2015-11-16 08:17:23 -06:00
Edgar Gabriel
e8e117503d
reduce the communication volume during MPI_File_set_view
2015-11-16 08:17:22 -06:00
Edgar Gabriel
f97655f28e
make sure the iov buffer is initialized to zero, otherwise bad things can happen for 0-byte contributions on a process.
2015-10-15 12:46:01 -05:00
William Throwe
80bb41a079
ROMIO configure looks for lstat in wrong header
...
ROMIO configure looks for lstat in wrong header
The ROMIO configure script checks for a declaration of lstat in
unistd.h, but, at least on the Linux machines I checked, lstat is in
sys/stat.h. (The detection failure led to a linker error when building
ROMIO as part of OpenMPI on one of my admittedly strangely configured
machines, somehow.) It appears from the man page that either location
is possible, so check both.
(cherry picked from mpich/mpich@7b8bd055df )
Signed-off-by: Rob Latham <robl@mcs.anl.gov>
Signed-off-by: Nathan Hjelm <hjelmn@lanl.gov>
2015-09-23 11:56:53 -06:00
Edgar Gabriel
3734a38370
this file should have been part of the previous commit. for removeing io_ompio_nbc.[ch]
2015-09-18 09:28:25 -05:00
Edgar Gabriel
cf46a6bd4d
remove the io_ompio_nbc.[ch] files, they are not used anymore at this point in time.
2015-09-18 09:26:25 -05:00
Gilles Gouaillardet
fe351f6801
io: do not cast way the const modifier when this is not necessary
...
update the io framework and mpi c bindings
2015-09-09 09:18:58 +09:00
Nathan Hjelm
f451876058
Merge pull request #825 from hjelmn/white_space_purge
...
periodic trailing whitespace purge
2015-08-25 19:23:52 -06:00
Edgar Gabriel
70078175ee
fix coverty warning 72107
2015-08-25 09:23:37 -05:00
Edgar Gabriel
a73f9470e0
fix coverty warning 1269829
2015-08-25 09:22:48 -05:00
Nathan Hjelm
156ce6af21
periodic whitespace purge
...
Signed-off-by: Nathan Hjelm <hjelmn@lanl.gov>
2015-08-24 09:32:33 -06:00
Edgar Gabriel
b0461f8d3c
the back pointer from the ompio_file structure to the ompi_file_t structure
...
has to be set earlier in case the user disables the lazy_open option.
2015-08-19 17:11:42 -05:00
Edgar Gabriel
7e370948c1
first cut on the fileview for shared filepointers fix.
2015-08-19 17:11:42 -05:00
Edgar Gabriel
072b18e197
Code cleanup for the time breakdown feature in ompio/fcoll
...
- make the internal structure follow the Open MPI naming convention
- provide a single flag/macro which controls the compilation/utilization of this
feature, to avoid that somebody using this has to modify every single
fcoll component. A configure option could be added later if desired.
2015-08-14 08:53:04 -05:00
Edgar Gabriel
4bfc6ae798
Performance tuning: incorporate the usage of non-blocking operations in our array group-communication operations.
2015-08-13 20:05:18 -05:00
Edgar Gabriel
9e29edf15c
remove a erroneous paranthesis which prevents the compilation of the lustre adio
2015-08-07 15:22:41 -05:00
Edgar Gabriel
0aa3049bfc
Performance tuning: change the default behavior of ompio to *not* segment individual read/write operations.
...
In most cases, performance seems to be better if not segmented.
2015-08-07 13:06:39 -05:00
Edgar Gabriel
db5af26de7
Performance tuning. make sure we catch if the user wants to set the default fileview and replace it with our optimized default file view. Otherwise, performance will suffer. file_get_view should still return the correct filetype, not our optimized default file view. This is the correct version compared to ffa67b9693
, which unfortunately broke
...
some test cases in mpi_test_suite. Thanks for @ggouaillardet for reporting this!
2015-08-07 12:49:58 -05:00
Edgar Gabriel
6f6c01ee8d
free the datatypes that were created using type_dup during file_set_view
2015-08-07 11:50:25 -05:00
Edgar Gabriel
1ae4f8c7e6
Revert "Performance tuning. make sure we catch if the user wants to set the default fileview and replace it with"
...
This reverts commit ffa67b9693
.
2015-08-07 09:53:07 -05:00
Howard Pritchard
8649a9f6ef
Merge pull request #757 from roblatham00/lustre-excl-open-fix
...
hint processing should not open files
2015-07-31 12:16:14 -06:00
Edgar Gabriel
ffa67b9693
Performance tuning. make sure we catch if the user wants to set the default fileview and replace it with
...
our optimized default file view. Otherwise, performance will suffer. file_get_view should still return the correct filetype, not our optimized default file view
2015-07-30 19:15:00 -05:00
Edgar Gabriel
9b2a7e41f0
make sure the final number of aggregators is recorded correctly when not using
...
our aggregator selection logic.
2015-07-30 17:24:01 -05:00
Rob Latham
6e9cbe397f
hint processing should not open files
...
move opening of files from hint processing and into open routines.
This is MPICH commit 92f1c69f0de8 and 22a77dceda11
see https://trac.mpich.org/projects/mpich/ticket/2261
Ref: https://github.com/open-mpi/ompi/issues/158
Signed-off-by: Pavan Balaji <balaji@anl.gov>
2015-07-30 12:25:20 -05:00
Edgar Gabriel
824d488709
- make the split collective shared file pointer operations work
...
- minor code restructering in io/ompio required for that.
2015-07-28 09:05:05 -05:00
Edgar Gabriel
e380f8c235
- fix the delete priority of the ompio component
...
- some application use MPI_File_delete as a collective function (e.g. IOR), which I think is not really covered by the standard. Right now, one process succeeds and theother ones return an error code. Fix that by not returning no error if the file that we try to delete does not exist anymore, to make these applications work.
2015-07-27 15:53:40 -05:00
Edgar Gabriel
3fb0614566
mark the request as ACTIVE
2015-07-27 12:43:45 -05:00
Edgar Gabriel
b484784dca
make ompio return gracefully in case something goes wrong early in file_open.
2015-07-20 10:03:16 -05:00
Edgar Gabriel
86c3000e18
fix the delete selection logic in io/base. With the previous version, there was a mismatch
...
in the version number and no component was selected for file_delete.
2015-07-20 10:01:30 -05:00
Edgar Gabriel
f2af8e94ff
- first cut on the io interface changes
...
- add the C interfaces for the new non-blocking collective I/O functions of MPI 3.1
2015-07-09 10:58:13 -05:00
Gilles Gouaillardet
9e89985f3d
restore whitespaces into the pdf files
2015-07-07 09:17:00 +09:00
Nathan Hjelm
4d92c9989e
more c99 updates
...
This commit does two things. It removes checks for C99 required
headers (stdlib.h, string.h, signal.h, etc). Additionally it removes
definitions for required C99 types (intptr_t, int64_t, int32_t, etc).
Signed-off-by: Nathan Hjelm <hjelmn@me.com>
2015-06-25 10:14:13 -06:00
Ralph Castain
869041f770
Purge whitespace from the repo
2015-06-23 20:59:57 -07:00
Edgar Gabriel
dedeee9771
finishing the changes for the non-blocking and split cpllective I/O operations. Everything except for the
...
interface changes to the io framework is done.
2015-06-18 06:22:41 -05:00
Edgar Gabriel
3b11a8b61c
making the current work compile.
2015-06-18 05:56:51 -05:00