Edgar Gabriel
dbfbcdecd5
make adjustments for the default settings of grouping parameters and the default contiguous group size option.
...
minor bug fix in the simple grouping strategy.
2015-11-16 08:17:27 -06:00
Edgar Gabriel
27628774c7
add a new option for a simple aggregator selection which has zero communication costs.
2015-11-16 08:17:26 -06:00
Edgar Gabriel
66c1ea5fcb
change the default value of the grouping option. Also add new grouping option which skips the refinement step in the aggregator selection.
2015-11-16 08:17:23 -06:00
Gilles Gouaillardet
fe351f6801
io: do not cast way the const modifier when this is not necessary
...
update the io framework and mpi c bindings
2015-09-09 09:18:58 +09:00
Edgar Gabriel
072b18e197
Code cleanup for the time breakdown feature in ompio/fcoll
...
- make the internal structure follow the Open MPI naming convention
- provide a single flag/macro which controls the compilation/utilization of this
feature, to avoid that somebody using this has to modify every single
fcoll component. A configure option could be added later if desired.
2015-08-14 08:53:04 -05:00
Edgar Gabriel
db5af26de7
Performance tuning. make sure we catch if the user wants to set the default fileview and replace it with our optimized default file view. Otherwise, performance will suffer. file_get_view should still return the correct filetype, not our optimized default file view. This is the correct version compared to ffa67b96933acafb3cfacf39a074d3dc1fe134ae, which unfortunately broke
...
some test cases in mpi_test_suite. Thanks for @ggouaillardet for reporting this!
2015-08-07 12:49:58 -05:00
Edgar Gabriel
824d488709
- make the split collective shared file pointer operations work
...
- minor code restructering in io/ompio required for that.
2015-07-28 09:05:05 -05:00
Ralph Castain
869041f770
Purge whitespace from the repo
2015-06-23 20:59:57 -07:00
Edgar Gabriel
3b11a8b61c
making the current work compile.
2015-06-18 05:56:51 -05:00
Edgar Gabriel
cc219281ba
checkpoint of the current work, since I need to resync wioth master to fix the compilation problems
2015-06-18 05:20:07 -05:00
Mangala Jyothi Bhaskar
c4de46e284
Fix number of aggregators used in two phase fcoll
2015-04-16 10:39:10 -05:00
Edgar Gabriel
4a5d3e705b
remove an unecessary comm_dup in case the internal file_open function is called from a sharedfp component.
2015-01-28 16:13:50 -06:00
Mangala Jyothi Bhaskar
68d78fd718
Aggregator selection logic Part 2 and reorganized Part1
2014-12-16 15:48:40 -06:00
Edgar Gabriel
0758d7570e
part 1 of the fix to get rid of the missing symbols that prevent the sub-modules to be loaded.
2014-11-29 20:01:36 -06:00
Mangala Jyothi Bhaskar
a5973c3f8c
revamp of the aggregator selection logic, part 1.
...
This commit was SVN r32557.
2014-08-20 19:28:04 +00:00
Edgar Gabriel
fabad95b8e
- extend the explicit offset patch to collective explicit offset operations as
...
well
- minor restructuring to support the shared file pointer operations correctly
for explicit offsets
This commit was SVN r32538.
2014-08-15 14:03:29 +00:00
Edgar Gabriel
da1b6c2e87
some code reorganization in preparation for non-blocking read and write
...
operations.
This commit was SVN r32534.
2014-08-14 20:17:58 +00:00
Edgar Gabriel
d4f83ab929
clean up of the MCA parameters of the fcoll framework. Most parameters are now
...
set/retrieved in ompio instead of the fcoll components.
This commit was SVN r32294.
2014-07-23 19:03:14 +00:00
Hadi Montakhabi
8af6b8b4e4
add support for PLFS filesystem
...
This commit was SVN r30370.
2014-01-22 21:16:15 +00:00
Edgar Gabriel
ac694b7056
in preparation for the new shared file pointer components to be committed
...
soon:
- add a new abstraction layer to be used internally for some operations
- add a new mca parameter to control lazy intialization of shared file
pointer structures
This commit was SVN r28826.
2013-07-17 21:30:50 +00:00
Vishwanath Venkatesan
2922fa28a6
Changes to the interface for extracting timing information,
...
to avoid accessing datastructures across frameworks.
This commit was SVN r27543.
2012-10-31 22:03:05 +00:00
Vishwanath Venkatesan
9eeb3b5d50
# Extracting timing information for individual components of collective algorithm using a generic queue.
...
# This is triggered based on a mca-paramater and can be used with all collective modules.
# Individual queues maintained for read and write.
# The additional communication to combine data is done at file-close so that the
actual timing of collective-operations will not get affected.
# The queues are initialized in file-open
This commit was SVN r27439.
2012-10-11 21:14:07 +00:00
Vishwanath Venkatesan
c89c9e40be
Code to extract neigbhouing offsets information from OMPIO into a file. Driven by an MCA parameter,
...
turned-off by default.
This commit was SVN r27407.
2012-10-04 21:53:26 +00:00
Vishwanath Venkatesan
dccfd18481
1. Removing two-phase support functions
...
2. Moving nbc headers to a seperate header file and modifying
io_ompio_nbc.c accordingly.
This commit was SVN r26921.
2012-07-31 04:39:13 +00:00
Edgar Gabriel
66c5a80dfd
- get rid of a warning about an unused variable
...
- return MPI_ERR_OTHER instead of MPI_SUCCESS for the functions that are not
yet implemented
- add another field to the mca_io_ompio_file_t structure to point back to the
ompi_file_t structure.
This commit was SVN r26908.
2012-07-30 15:29:59 +00:00
Edgar Gabriel
d18dad7109
remove the file io_ompio_coll_offset. These routines were the predecessors of
...
the routines in io_ompio_coll_array. No need to keep both versions around.
This commit was SVN r26766.
2012-07-09 17:12:46 +00:00
Edgar Gabriel
8ae22cacc1
- remove two functions that were not used anymore
...
- change the location where we mark the file view as contiguous and the
condition on how it is determined to be contiguous
- remove the unnecessary include statements
This commit was SVN r26763.
2012-07-08 12:57:17 +00:00
Edgar Gabriel
288d044097
get rid of the fcache framework. It was not being used as originally intended.
...
This commit was SVN r26668.
2012-06-26 19:53:26 +00:00
Vishwanath Venkatesan
37c8470e3d
modified implementation for two-phase write_all incorporating romio style domain partitioning
...
This commit was SVN r25680.
2011-12-22 00:16:29 +00:00
Vishwanath Venkatesan
738a67b704
Removing duplicate code while setting default file view and using internal file-set-view for setting the default file view
...
This commit was SVN r25679.
2011-12-21 21:50:47 +00:00
George Bosilca
649af6c925
Enumerated mixed with another type (int) is tolerated but
...
easily fixable.
This commit was SVN r25241.
2011-10-09 03:54:52 +00:00
Edgar Gabriel
196c3819e2
- revamp the configure logic to detect pvfs2 and lustre
...
- slight change in the selection logic of the fs module, which makes
the ompio independent of the file system type (otherwise ompio
would also have required a configure script).
This commit was SVN r25118.
2011-09-07 10:39:47 +00:00
Edgar Gabriel
52063267df
commit of the OMPIO modules and frameworks.
...
This commit was SVN r25079.
2011-08-25 20:08:17 +00:00