Edgar Gabriel
072b18e197
Code cleanup for the time breakdown feature in ompio/fcoll
...
- make the internal structure follow the Open MPI naming convention
- provide a single flag/macro which controls the compilation/utilization of this
feature, to avoid that somebody using this has to modify every single
fcoll component. A configure option could be added later if desired.
2015-08-14 08:53:04 -05:00
Edgar Gabriel
4bfc6ae798
Performance tuning: incorporate the usage of non-blocking operations in our array group-communication operations.
2015-08-13 20:05:18 -05:00
Edgar Gabriel
0aa3049bfc
Performance tuning: change the default behavior of ompio to *not* segment individual read/write operations.
...
In most cases, performance seems to be better if not segmented.
2015-08-07 13:06:39 -05:00
Edgar Gabriel
db5af26de7
Performance tuning. make sure we catch if the user wants to set the default fileview and replace it with our optimized default file view. Otherwise, performance will suffer. file_get_view should still return the correct filetype, not our optimized default file view. This is the correct version compared to ffa67b96933acafb3cfacf39a074d3dc1fe134ae, which unfortunately broke
...
some test cases in mpi_test_suite. Thanks for @ggouaillardet for reporting this!
2015-08-07 12:49:58 -05:00
Edgar Gabriel
6f6c01ee8d
free the datatypes that were created using type_dup during file_set_view
2015-08-07 11:50:25 -05:00
Edgar Gabriel
1ae4f8c7e6
Revert "Performance tuning. make sure we catch if the user wants to set the default fileview and replace it with"
...
This reverts commit ffa67b96933acafb3cfacf39a074d3dc1fe134ae.
2015-08-07 09:53:07 -05:00
Edgar Gabriel
ffa67b9693
Performance tuning. make sure we catch if the user wants to set the default fileview and replace it with
...
our optimized default file view. Otherwise, performance will suffer. file_get_view should still return the correct filetype, not our optimized default file view
2015-07-30 19:15:00 -05:00
Edgar Gabriel
9b2a7e41f0
make sure the final number of aggregators is recorded correctly when not using
...
our aggregator selection logic.
2015-07-30 17:24:01 -05:00
Edgar Gabriel
824d488709
- make the split collective shared file pointer operations work
...
- minor code restructering in io/ompio required for that.
2015-07-28 09:05:05 -05:00
Edgar Gabriel
e380f8c235
- fix the delete priority of the ompio component
...
- some application use MPI_File_delete as a collective function (e.g. IOR), which I think is not really covered by the standard. Right now, one process succeeds and theother ones return an error code. Fix that by not returning no error if the file that we try to delete does not exist anymore, to make these applications work.
2015-07-27 15:53:40 -05:00
Edgar Gabriel
3fb0614566
mark the request as ACTIVE
2015-07-27 12:43:45 -05:00
Edgar Gabriel
b484784dca
make ompio return gracefully in case something goes wrong early in file_open.
2015-07-20 10:03:16 -05:00
Edgar Gabriel
f2af8e94ff
- first cut on the io interface changes
...
- add the C interfaces for the new non-blocking collective I/O functions of MPI 3.1
2015-07-09 10:58:13 -05:00
Ralph Castain
869041f770
Purge whitespace from the repo
2015-06-23 20:59:57 -07:00
Edgar Gabriel
dedeee9771
finishing the changes for the non-blocking and split cpllective I/O operations. Everything except for the
...
interface changes to the io framework is done.
2015-06-18 06:22:41 -05:00
Edgar Gabriel
3b11a8b61c
making the current work compile.
2015-06-18 05:56:51 -05:00
Edgar Gabriel
cc219281ba
checkpoint of the current work, since I need to resync wioth master to fix the compilation problems
2015-06-18 05:20:07 -05:00
Edgar Gabriel
100515e321
remove split collective interfaces from fcoll and their fake implemenations. Not required anymore
2015-06-18 05:20:07 -05:00
Gilles Gouaillardet
0f08070a1c
ompio: fix misc memory leaks
...
as identified by Coverity with CIDs 72147-72149, 731275 and 1269872
2015-06-17 11:17:54 +09:00
Edgar Gabriel
aa72e5b2ca
fix the selection logic to not overwrite on the new aggregator side the list of
...
aggregators determined by the algorithm.
2015-05-27 22:35:45 -05:00
Gilles Gouaillardet
b6c67e051d
io/ompio: fix misc memory leaks
...
as reported by Coverity with CIDs 72147-72149,72187,72188,731274,731275,741356,
1269889,1269893,1271535 and 1269872
2015-05-20 17:19:39 +09:00
Gilles Gouaillardet
9d56b85b55
initialize common symbols from ompi
2015-05-08 10:11:58 +09:00
Nathan Hjelm
df75d0382f
ompi: use C99 subobject naming for component initialization
...
This commit helps future-proof ompi components by initializing each
component member by name.
Signed-off-by: Nathan Hjelm <hjelmn@lanl.gov>
2015-04-18 10:29:58 -06:00
Mangala Jyothi Bhaskar
c4de46e284
Fix number of aggregators used in two phase fcoll
2015-04-16 10:39:10 -05:00
Gilles Gouaillardet
f03d7dce17
ompio: fix deallocation sequence
...
as reported by Coverity with CID 1287034
2015-03-06 14:59:59 +09:00
Gilles Gouaillardet
5b2122381b
ompio: fix misc memory leaks
...
as reported by Coverity with CIDs 72127, 72145, 72146, 72177, 72179,
72186, 731276, 731278, 1269888, 1269890
2015-03-05 16:22:19 +09:00
Jeff Squyres
657d2cf77b
io_ompi: check the correct returned value
...
This was CID 731273
2015-02-24 15:24:11 -05:00
Howard Pritchard
bf89131f9e
add owner files to opa/ompi/orte mca directories
...
This commit adds an owner file in each of the component directories
for each framework. This allows for a simple script to parse
the contents of the files and generate, among other things, tables
to be used on the project's wiki page. Currently there are two
"fields" in the file, an owner and a status. A tool to parse
the files and generate tables for the wiki page will be added
in a subsequent commit.
2015-02-22 15:10:23 -07:00
Gilles Gouaillardet
b68e1cd579
ompio: fix memory leaks reported by Coverity scan
...
and silence CID 72195
2015-02-13 13:18:44 +09:00
Edgar Gabriel
62282a0f06
part 1 of cleaning up the info handling in the ompio component.
2015-01-30 16:13:15 -06:00
Edgar Gabriel
2d79963cb3
mark the request as an IO request
2015-01-29 08:41:24 -06:00
Edgar Gabriel
4a5d3e705b
remove an unecessary comm_dup in case the internal file_open function is called from a sharedfp component.
2015-01-28 16:13:50 -06:00
Edgar Gabriel
51cee4a083
call the actual backend functions for file_get_position_shared and file_seek_shared. The sharedfp components
...
do provide the implementations, we just did not invoke them yet.
2015-01-28 13:47:54 -06:00
mjbhaskar
74f8ba2acb
A fix for memory corruption problem
2015-01-07 14:34:38 -06:00
Mangala Jyothi Bhaskar
68d78fd718
Aggregator selection logic Part 2 and reorganized Part1
2014-12-16 15:48:40 -06:00
Mangala Jyothi Bhaskar
2bd52cc410
Initialize req variable to fix a warning
2014-12-16 13:24:28 -06:00
Edgar Gabriel
0758d7570e
part 1 of the fix to get rid of the missing symbols that prevent the sub-modules to be loaded.
2014-11-29 20:01:36 -06:00
Edgar Gabriel
05c34946f7
implementation of non-blocking read/write operations through aio
...
functions for the posix module. Som interface changes for the fbtl were
necessary for that.
This commit was SVN r32777.
2014-09-23 21:27:57 +00:00
Mangala Jyothi Bhaskar
dc05b709a7
it is ok to not have a sharedfp component selected, as long as no
...
sharedfp functionality is being used. Return an error however if no
sharedfp component is selected and the applications calls a
file_read/write_shared function.
This commit was SVN r32718.
2014-09-12 21:15:58 +00:00
Edgar Gabriel
597177cd8b
silence a warning regarding the return value of the fbtl's.
...
This commit was SVN r32717.
2014-09-12 18:01:30 +00:00
Mangala Jyothi Bhaskar
cd78a3a026
Fixed offset data type in communication
...
This commit was SVN r32710.
2014-09-11 14:51:30 +00:00
Mangala Jyothi Bhaskar
4ff21d6178
Fixed offset data type in communication
...
This commit was SVN r32709.
2014-09-11 14:51:07 +00:00
Mangala Jyothi Bhaskar
6e5f2c8ae8
Fixed offset data type in communication
...
This commit was SVN r32708.
2014-09-11 14:50:30 +00:00
Edgar Gabriel
ed02927767
- do not set the contiguous memory option in the collective operations. It
...
should not be stored on the file handle anyway, since it is not a property of
the file.
- protect a realloc for zero byte scenarios.
This commit was SVN r32678.
2014-09-07 18:09:43 +00:00
Edgar Gabriel
0f59ce6591
use the fbtl return value as originally intended, namely to retrieve the
...
number of bytes written and read. Status contains now the actual number of
bytes written for individual operations. For collective operations, this is
unfortunately not possible.
This commit was SVN r32674.
2014-09-07 15:14:57 +00:00
Edgar Gabriel
52eac0146d
cleanup of the fbtl interfaces: remove the *sorted optimization flag, since it
...
was not used anyway in the last two years. Simplifies the code significantly.
This commit was SVN r32602.
2014-08-25 18:04:24 +00:00
Ralph Castain
ac0c584eb7
Add missing file
...
This commit was SVN r32588.
2014-08-23 04:31:35 +00:00
Edgar Gabriel
9987135da0
add initial support for non-blocking read and write operations.
...
This commit was SVN r32571.
2014-08-22 01:34:19 +00:00
Mangala Jyothi Bhaskar
a5973c3f8c
revamp of the aggregator selection logic, part 1.
...
This commit was SVN r32557.
2014-08-20 19:28:04 +00:00
Edgar Gabriel
fabad95b8e
- extend the explicit offset patch to collective explicit offset operations as
...
well
- minor restructuring to support the shared file pointer operations correctly
for explicit offsets
This commit was SVN r32538.
2014-08-15 14:03:29 +00:00