4bbb22bd0b
add a new field to the ompio data structure (stripe_count) and set it correctly on pvfs2 and lustre.
2016-01-17 09:48:49 -06:00
dbfbcdecd5
make adjustments for the default settings of grouping parameters and the default contiguous group size option.
...
minor bug fix in the simple grouping strategy.
2015-11-16 08:17:27 -06:00
27628774c7
add a new option for a simple aggregator selection which has zero communication costs.
2015-11-16 08:17:26 -06:00
66c1ea5fcb
change the default value of the grouping option. Also add new grouping option which skips the refinement step in the aggregator selection.
2015-11-16 08:17:23 -06:00
fe351f6801
io: do not cast way the const modifier when this is not necessary
...
update the io framework and mpi c bindings
2015-09-09 09:18:58 +09:00
072b18e197
Code cleanup for the time breakdown feature in ompio/fcoll
...
- make the internal structure follow the Open MPI naming convention
- provide a single flag/macro which controls the compilation/utilization of this
feature, to avoid that somebody using this has to modify every single
fcoll component. A configure option could be added later if desired.
2015-08-14 08:53:04 -05:00
db5af26de7
Performance tuning. make sure we catch if the user wants to set the default fileview and replace it with our optimized default file view. Otherwise, performance will suffer. file_get_view should still return the correct filetype, not our optimized default file view. This is the correct version compared to ffa67b9693
, which unfortunately broke
...
some test cases in mpi_test_suite. Thanks for @ggouaillardet for reporting this!
2015-08-07 12:49:58 -05:00
824d488709
- make the split collective shared file pointer operations work
...
- minor code restructering in io/ompio required for that.
2015-07-28 09:05:05 -05:00
869041f770
Purge whitespace from the repo
2015-06-23 20:59:57 -07:00
3b11a8b61c
making the current work compile.
2015-06-18 05:56:51 -05:00
cc219281ba
checkpoint of the current work, since I need to resync wioth master to fix the compilation problems
2015-06-18 05:20:07 -05:00
c4de46e284
Fix number of aggregators used in two phase fcoll
2015-04-16 10:39:10 -05:00
4a5d3e705b
remove an unecessary comm_dup in case the internal file_open function is called from a sharedfp component.
2015-01-28 16:13:50 -06:00
68d78fd718
Aggregator selection logic Part 2 and reorganized Part1
2014-12-16 15:48:40 -06:00
0758d7570e
part 1 of the fix to get rid of the missing symbols that prevent the sub-modules to be loaded.
2014-11-29 20:01:36 -06:00
a5973c3f8c
revamp of the aggregator selection logic, part 1.
...
This commit was SVN r32557.
2014-08-20 19:28:04 +00:00
fabad95b8e
- extend the explicit offset patch to collective explicit offset operations as
...
well
- minor restructuring to support the shared file pointer operations correctly
for explicit offsets
This commit was SVN r32538.
2014-08-15 14:03:29 +00:00
da1b6c2e87
some code reorganization in preparation for non-blocking read and write
...
operations.
This commit was SVN r32534.
2014-08-14 20:17:58 +00:00
d4f83ab929
clean up of the MCA parameters of the fcoll framework. Most parameters are now
...
set/retrieved in ompio instead of the fcoll components.
This commit was SVN r32294.
2014-07-23 19:03:14 +00:00
8af6b8b4e4
add support for PLFS filesystem
...
This commit was SVN r30370.
2014-01-22 21:16:15 +00:00
ac694b7056
in preparation for the new shared file pointer components to be committed
...
soon:
- add a new abstraction layer to be used internally for some operations
- add a new mca parameter to control lazy intialization of shared file
pointer structures
This commit was SVN r28826.
2013-07-17 21:30:50 +00:00
2922fa28a6
Changes to the interface for extracting timing information,
...
to avoid accessing datastructures across frameworks.
This commit was SVN r27543.
2012-10-31 22:03:05 +00:00
9eeb3b5d50
# Extracting timing information for individual components of collective algorithm using a generic queue.
...
# This is triggered based on a mca-paramater and can be used with all collective modules.
# Individual queues maintained for read and write.
# The additional communication to combine data is done at file-close so that the
actual timing of collective-operations will not get affected.
# The queues are initialized in file-open
This commit was SVN r27439.
2012-10-11 21:14:07 +00:00
c89c9e40be
Code to extract neigbhouing offsets information from OMPIO into a file. Driven by an MCA parameter,
...
turned-off by default.
This commit was SVN r27407.
2012-10-04 21:53:26 +00:00
dccfd18481
1. Removing two-phase support functions
...
2. Moving nbc headers to a seperate header file and modifying
io_ompio_nbc.c accordingly.
This commit was SVN r26921.
2012-07-31 04:39:13 +00:00
66c5a80dfd
- get rid of a warning about an unused variable
...
- return MPI_ERR_OTHER instead of MPI_SUCCESS for the functions that are not
yet implemented
- add another field to the mca_io_ompio_file_t structure to point back to the
ompi_file_t structure.
This commit was SVN r26908.
2012-07-30 15:29:59 +00:00
d18dad7109
remove the file io_ompio_coll_offset. These routines were the predecessors of
...
the routines in io_ompio_coll_array. No need to keep both versions around.
This commit was SVN r26766.
2012-07-09 17:12:46 +00:00
8ae22cacc1
- remove two functions that were not used anymore
...
- change the location where we mark the file view as contiguous and the
condition on how it is determined to be contiguous
- remove the unnecessary include statements
This commit was SVN r26763.
2012-07-08 12:57:17 +00:00
288d044097
get rid of the fcache framework. It was not being used as originally intended.
...
This commit was SVN r26668.
2012-06-26 19:53:26 +00:00
37c8470e3d
modified implementation for two-phase write_all incorporating romio style domain partitioning
...
This commit was SVN r25680.
2011-12-22 00:16:29 +00:00
738a67b704
Removing duplicate code while setting default file view and using internal file-set-view for setting the default file view
...
This commit was SVN r25679.
2011-12-21 21:50:47 +00:00
649af6c925
Enumerated mixed with another type (int) is tolerated but
...
easily fixable.
This commit was SVN r25241.
2011-10-09 03:54:52 +00:00
196c3819e2
- revamp the configure logic to detect pvfs2 and lustre
...
- slight change in the selection logic of the fs module, which makes
the ompio independent of the file system type (otherwise ompio
would also have required a configure script).
This commit was SVN r25118.
2011-09-07 10:39:47 +00:00
52063267df
commit of the OMPIO modules and frameworks.
...
This commit was SVN r25079.
2011-08-25 20:08:17 +00:00