Galen Shipman
3efecaaeda
convert openib btl to use new mca_param registration.. Also, change rr_buf_min
...
and rr_buf_max to rd_min and rd_max
This commit was SVN r7786.
2005-10-17 20:00:34 +00:00
Tim Woodall
c944988b9e
merge in changes from release branch - acquire/release send token for put/get
...
This commit was SVN r7784.
2005-10-17 18:59:28 +00:00
Brian Barrett
1302cb4072
The next in a long line of crazed build system changes from Brian. This was
...
originally suggested by Ralf Wildenhues, to try to speed autogen, configure,
and make (and possibly even make install). Use automake's include directive
to drastically reduce the number of Makefile files (although the number of
Makefile.am files is the same - most are just included in a top-level
Makefile.am). Also use an Automake SUBDIRs feature to eliminate the
dynamic-mca tree, which was no longer really needed. This makes adding
a framework easier (since you don't have to remember the dynamic-mca
tree) and makes building faster (as make doesn't have to recurse through
the dynamic-mca tree)
This commit was SVN r7777.
2005-10-17 00:21:10 +00:00
Edgar Gabriel
7e45f64065
reduce has now been tested quite extensively for all (predefined) operations
...
and for all root nodes and passed all tests.
First cut on barrier (which from my perspective does not make sense from the
performance point of view) and on allreduce (which might make sense),
This commit was SVN r7774.
2005-10-15 22:24:44 +00:00
Edgar Gabriel
3fab9c628c
switching the root and creating (if necessary) the new local leader sub-communicators seems to work as well. Thoroughly tested with bcast, not yet that exhaustivly tested for the reduction.
...
This commit was SVN r7773.
2005-10-15 21:13:44 +00:00
Edgar Gabriel
7d34770456
further bugfixes. The hierarchy detection works now as far as I can see (even in unsymmetric sitations). Bcast and reduce work as well. Still to test: the code which generates new local leader communicators, in case the root of the operation is not yet part of the lleader comm.
...
This commit was SVN r7772.
2005-10-15 19:36:54 +00:00
Edgar Gabriel
63554d245f
further bugfixes
...
This commit was SVN r7771.
2005-10-15 18:44:57 +00:00
Edgar Gabriel
92c7b77cbc
minor bug fixes
...
This commit was SVN r7770.
2005-10-15 18:32:40 +00:00
Edgar Gabriel
ba163c611c
checkpoint before moving to a real cluster. Most of the recoding should be
...
done. This version also doesn't break ompi (at least if its not chosen :-) ).
New features compared to the version from last Thursday (where bcast and
reduce seemed to work in most scenarios):
- clearer internal infrastructure
- ability to handle all root processes with a (hopefully) minimal number of
local leader communicators.
This commit was SVN r7769.
2005-10-15 17:04:01 +00:00
Edgar Gabriel
84c070fc0f
get rid of the different modes how to store the colorarray for now. Might be
...
reintroduced later as an optimization.
This commit was SVN r7762.
2005-10-14 18:11:21 +00:00
Edgar Gabriel
6d14440972
checkpoint for moving again to another machine. major rewrite to clean
...
up internal interfaces in progress.
This commit was SVN r7761.
2005-10-14 17:41:44 +00:00
Edgar Gabriel
770aeaf97b
modifications towards adding new local-leader communicators.
...
This commit was SVN r7760.
2005-10-14 12:18:29 +00:00
Graham Fagg
636b42afff
handle non existant recv buf in reduce for non root processes
...
(basic allreduce does this for mpi_in_place case)
This commit was SVN r7759.
2005-10-14 00:00:37 +00:00
Graham Fagg
61b8218d76
MPI_IN_PLACE fix for reduce.
...
(actually a work around for an optimisation in the reduce for not saving ops on the first recv of each segment)
Minor change in topo.
This commit was SVN r7758.
2005-10-13 23:38:21 +00:00
Edgar Gabriel
48f2563b4c
checkpoint. Moving to another machine.
...
This commit was SVN r7757.
2005-10-13 20:04:26 +00:00
Edgar Gabriel
4b05359b16
minor fixes when freeing the component
...
This commit was SVN r7756.
2005-10-13 18:22:16 +00:00
Edgar Gabriel
0a5a346bbb
first cut on the reduce operation.
...
This commit was SVN r7755.
2005-10-13 17:58:13 +00:00
Edgar Gabriel
30af775d40
further fixes. The first hierarchical MPI_Bcast works! Its just ~ 100 times slower then basic at the moment :-)
...
This commit was SVN r7754.
2005-10-13 17:34:42 +00:00
Edgar Gabriel
460b5cb840
further corrections to the hierarchy detection algorithms. It seems to work now as far as my tests show...
...
This commit was SVN r7753.
2005-10-13 16:21:13 +00:00
Edgar Gabriel
f5d16419b2
fix in the logic regarding protocol detection.
...
This commit was SVN r7749.
2005-10-13 15:07:35 +00:00
Edgar Gabriel
5d7fbd9d2e
minor change in bml_r2_add_procs: the memory for the bml_endpoints structure
...
has to be allocated outside of the routine. Thus, the update version of pml/ob1/oml_ob1.c
This commit was SVN r7739.
2005-10-12 20:59:25 +00:00
Edgar Gabriel
3e5ad3e681
Updates
...
This commit was SVN r7738.
2005-10-12 20:56:29 +00:00
Tim Woodall
22f460bdc5
merge in changes from release branch
...
This commit was SVN r7737.
2005-10-12 20:24:43 +00:00
Tim Woodall
6da9561ea8
merge in correction from v1.0
...
This commit was SVN r7732.
2005-10-12 16:40:52 +00:00
Tim Woodall
d859855dea
merge in changes from 1.0
...
This commit was SVN r7728.
2005-10-12 15:54:35 +00:00
Edgar Gabriel
25518b63c5
first version of coll_hierarch which does not crash the rest of the
...
library as long as its not selected :-)
This commit was SVN r7707.
2005-10-11 22:05:24 +00:00
Edgar Gabriel
0675c22dab
updating with Jeff's help to the recent autogen/configure system
...
This commit was SVN r7705.
2005-10-11 21:50:16 +00:00
Edgar Gabriel
7b07dbc163
another round of fixes. Unfortunatly, I also have to provide a trivial
...
version of reduce and gather to make all this work....
This commit was SVN r7702.
2005-10-11 21:26:07 +00:00
Tim Woodall
4a71621410
merge in scheduling changes from release branch
...
This commit was SVN r7699.
2005-10-11 20:41:51 +00:00
Edgar Gabriel
c8adc2e65e
coding around the collective operations
...
This commit was SVN r7698.
2005-10-11 20:34:17 +00:00
Edgar Gabriel
083d0b9630
Checkpoint: most of the coding should be done for the basic
...
infrastructure.
This commit was SVN r7696.
2005-10-11 19:45:21 +00:00
Graham Fagg
607bdf51b6
Last Cleanup BEFORE adding last two methods and final cross over points.
...
- new mca param calls
- move printfs to OPAL_OUTPUT
This commit was SVN r7692.
2005-10-11 18:51:03 +00:00
Edgar Gabriel
b42d4ac780
Checkpoint:
...
- update the hierarch stuff to use btl's instead of ptl's
- start the new logic regarding how to handle local leader communicators
This commit was SVN r7691.
2005-10-11 17:29:59 +00:00
Galen Shipman
23cbac25c8
lower default free list sizes..
...
This commit was SVN r7676.
2005-10-09 18:15:12 +00:00
Galen Shipman
fb19cc4177
compiler warning fixes..
...
This commit was SVN r7661.
2005-10-07 17:38:34 +00:00
Jeff Squyres
b22fab2826
Fix for a bug Galen noticed yesterday -- make the shared memory only
...
be allocated the first time a sm coll is selected for a communicator,
not before.
This commit was SVN r7647.
2005-10-06 13:17:27 +00:00
George Bosilca
1fe18814da
Decrease the default length for the first fragment.
...
This commit was SVN r7643.
2005-10-06 00:05:01 +00:00
George Bosilca
0f04132b13
mx_connect in the MX documentation is supposed to take a timeout in seconds. However, in real life it seems that the timeout should be in micro-second.
...
This commit was SVN r7642.
2005-10-06 00:04:27 +00:00
Brian Barrett
b7ef094766
* the cid in the header is only 16 bits, so limit our max cid to what can fit in there.
...
This commit was SVN r7639.
2005-10-05 15:43:28 +00:00
Jeff Squyres
83b5a675f9
Don't automatically take the first entry off the selected component
...
list; be sure to check its priority against the basic component and
take the one with the higher priority.
This commit was SVN r7621.
2005-10-04 17:09:45 +00:00
Jeff Squyres
b17c4334c4
- Remove all vestigates of using the built-in mcb_tree from the
...
reduce_inorder() function -- we don't use the tree at all.
- Add more relevant "volatile"'s for the control buffers in the
fragment mpool (and associated casts where necessary)
This commit was SVN r7616.
2005-10-04 14:52:59 +00:00
Tim Woodall
3b4a134a24
- removed unused define
...
- correct free to release registration rather than retain it
This commit was SVN r7611.
2005-10-04 14:33:26 +00:00
George Bosilca
f8355ec104
Cast the right side member to void* before assignment.
...
This commit was SVN r7608.
2005-10-04 12:37:23 +00:00
George Bosilca
6b3d02b514
Warning cleanups. On some OSes the iov_base member of the iovec structure is defined as an void * when
...
on others as an char*. Thus the right side of all assignment should be explicitly casted to an void* in
order to avoid any casting complaints from the compilers.
This commit was SVN r7607.
2005-10-04 12:36:07 +00:00
George Bosilca
3453a6c0e9
Remove some compiler warnings about unused variables
...
Correctly define the 64 bits constants.
Some minor cleanups.
This commit was SVN r7606.
2005-10-04 12:29:51 +00:00
George Bosilca
492c0e59dc
Correct the casting type and remove some useless output (already commented out).
...
This commit was SVN r7605.
2005-10-04 12:28:47 +00:00
Tim Woodall
c05ef28f6e
- added routine to ompi_pointer_array to remove array contents
...
- corrected memory hook callback to catch all allocations (need to optimize this)
- don't attempt to consolidate allocations
This commit was SVN r7600.
2005-10-03 23:29:26 +00:00
Jeff Squyres
c7fe54ba44
- Remove some silly compiler warnings
...
- Move the "process 0" logic out of the main loop in reduce to make
the code a bit less complex (at the price of slight code
duplication, but it iss now significantly easier to read)
- Fix problem with uniquenes guarantee in the bootstrap mpool -- using
the CID alone was not sufficient enough to guarantee uniquenes; now
use (CID, rank 0 process name) tuple to check for uniqueness
- Made a few debugging help changes in coll_sm.h; especially helps
debugging on uniprocessors
This commit was SVN r7599.
2005-10-03 21:34:58 +00:00
Jeff Squyres
2cedfeec53
- Eliminate some unused base globals
...
- Move one base global to the basic component and make it an MCA
parameter
- Convert the basic component to use the new MCA param API
This commit was SVN r7598.
2005-10-03 21:07:42 +00:00
Jeff Squyres
57fb96b018
Clarification of a help message
...
This commit was SVN r7597.
2005-10-03 21:06:13 +00:00
Jeff Squyres
ab099fa8cb
Re-indent; real commit with some changes coming shortly.
...
This commit was SVN r7596.
2005-10-03 19:56:39 +00:00
Galen Shipman
eefe0fd04a
fix threaded compile
...
fix misc warnings
cleanup posting of receive descriptors
comment why we retain before deregister in rcache_rb_mru.c
This commit was SVN r7595.
2005-10-03 16:35:12 +00:00
Galen Shipman
f46548e691
Add SRQ support to OpenIB btl, removed old mca param - not used..
...
This commit was SVN r7585.
2005-10-02 18:58:57 +00:00
Jeff Squyres
10064df0e9
Remove compiler warning
...
This commit was SVN r7578.
2005-10-02 10:43:53 +00:00
Jeff Squyres
37fc944b01
Use the right number of segments per in-use flag when calculating
...
offsets.
This commit was SVN r7571.
2005-09-30 23:12:23 +00:00
Galen Shipman
67d38b7896
Add multi-nic support to openib
...
Fix connection establishment race in openib
Other misc
This commit was SVN r7570.
2005-09-30 22:58:09 +00:00
Jeff Squyres
934caaf449
Fix at least one segv; use the right number of segments (i.e., the
...
number o segments in the fragment pool, not in the bootstrap pool)
This commit was SVN r7565.
2005-09-30 18:01:15 +00:00
Brian Barrett
db872a0fbb
* check that return from ibv_get_devices isn't NULL before calling dlist_start().
...
On thor, if IB is down, we get NULL back from ibv_get_devices(), which then
caused segfaults in dlist_start().
* Pretty-print error message if no HCAs found
This commit was SVN r7557.
2005-09-30 14:58:59 +00:00
Jeff Squyres
fcef1774d5
Per advice from Ralf W., change the pkgdata declarations in
...
Makefile.am's to be a *slightly* more correct (and, more importantly,
less error-prone) construct.
This commit was SVN r7554.
2005-09-30 13:32:39 +00:00
Jeff Squyres
80b7deb4d7
Add in EXTRA_DIST to get helpfile in tarballs
...
This commit was SVN r7553.
2005-09-30 10:25:04 +00:00
Brian Barrett
7b20370306
* pretty-print an error message if a btl component loads but can't find
...
any NICs to use
* Make mvapi, gm, and mx components all publish information, even if there
are no NICs available so that modex_recv doesn't hang. If there are no
NICs available, don't set the reachable bit, but don't do anything
to fail. This unfortunately doesn't cover the hangs that will result if
different procs load different sets of components, but it's a start
This commit was SVN r7550.
2005-09-30 04:39:44 +00:00
Brian Barrett
a77c908496
* the last of the tuning params for portals
...
This commit was SVN r7548.
2005-09-30 04:05:31 +00:00
Galen Shipman
8239e635b9
fix misc warnings, cleanup macro..
...
This commit was SVN r7547.
2005-09-30 03:13:51 +00:00
Galen Shipman
05e6e51fec
re-reg from min of bases and max of bounds
...
add byte counting for total registered memory
This commit was SVN r7546.
2005-09-29 21:28:54 +00:00
Jeff Squyres
bc181d7130
Remove the .ompi_ignore so that everyone starts compiling this, but
...
lower the default priority to 0 so that it's not active unless you
specifically ask for it (this component needs more testing by people
other than me before we unleash it on the public).
This commit was SVN r7545.
2005-09-29 18:05:47 +00:00
Brian Barrett
997644af31
* There are now two forms of ibv_create_cq, one with 3 params and one with 5.
...
Try to detect which form this version of Open IB uses, defaulting to the 5
version if we can't figure it out (the new version has 5 params)
* Only add -lcm if it exists on the system - some versions of Open IB
apparently don't need it.
This commit was SVN r7542.
2005-09-29 13:35:57 +00:00
Galen Shipman
3ded88a3c0
use addr +size -1 instead of base->addr as base->addr is down_aligned.
...
This commit was SVN r7536.
2005-09-28 20:19:33 +00:00
Galen Shipman
26a74d42fa
release, not retain on gm_free
...
This commit was SVN r7535.
2005-09-28 20:18:52 +00:00
Edgar Gabriel
67dd52efb1
making the allreduce and reduce_scatter tests pass as well
...
This commit was SVN r7532.
2005-09-28 15:12:05 +00:00
Galen Shipman
c1f5543f62
need to call mpool_release on all registrations obtained in the pml.
...
sanity checks
This commit was SVN r7530.
2005-09-28 04:49:40 +00:00
Galen Shipman
b9b78f8f5d
modify rcache_rb to find registrations in the middle of a base and bound
...
This commit was SVN r7528.
2005-09-28 02:11:35 +00:00
Edgar Gabriel
dbbbd416df
fixing MPI_IN_PLACE for the log-reduce algorithm.
...
This commit was SVN r7526.
2005-09-27 21:51:55 +00:00
Galen Shipman
0fc17cedee
change order of ops on register
...
This commit was SVN r7525.
2005-09-27 21:43:41 +00:00
Galen Shipman
09e67ce4fd
fix off by one on up_align_addr, use base and bound instead of base_align and
...
bound_align..
This commit was SVN r7521.
2005-09-27 18:10:44 +00:00
Galen Shipman
af04b3e1ab
fix warnings..
...
This commit was SVN r7515.
2005-09-27 14:23:51 +00:00
Galen Shipman
3c97b3f722
Modified the registration to include a base_align and bound_align for
...
searching the tree. Modified the memory callback to search the tree at each
page boundary for registrations. This is necessary as an application may
malloc memory and send out of any portion of that memory, even discontiguous
regions.
This commit was SVN r7510.
2005-09-27 02:01:21 +00:00
Brian Barrett
d9e80d8f2a
* increase size of event queue for receives - it was too small to be useful
...
on a reasonably sized machine
* if no mpool exists, don't try to malloc out an array of 0 bytes
This commit was SVN r7507.
2005-09-25 17:04:03 +00:00
Galen Shipman
384c472c94
reset ompi_pointer_array in mca_rcache_rb_find otherwise you might use an old
...
registration by accident..
This commit was SVN r7506.
2005-09-24 20:48:14 +00:00
Galen Shipman
02ce7a176e
had that backwards..
...
This commit was SVN r7504.
2005-09-24 16:58:07 +00:00
Galen Shipman
d1246be47e
should be strictly > or <
...
This commit was SVN r7503.
2005-09-24 16:45:34 +00:00
Galen Shipman
c53d51778a
fix for warnings..
...
This commit was SVN r7501.
2005-09-24 15:08:28 +00:00
Galen Shipman
9fe5844071
decrement ref count on removal of registration from mru and tree.
...
add misc asserts to check for proper reference counting.
ugly hack 1 -- use mallopt to never release memory ala sbrk - this is
commented out in mca_btl_mvapi_component_init
ugly hack 2 -- test registrations comming out of the tree via rcache_find, for
an unknown reason the tree is returning registrations where the address is not
within the base or bound of the registration. If this happens, we return
NULL.
comment out code to enable mem hooks if leave_pinned is set, note we can do
this via an mca param and will default it to leave_pinned with mem_hooks when
we iron out these issues.
I am adding a unit test for the rcache. Note that we have a unit test for the
rb tree but the compare function is significantly different than that used for
registrations. After we have tracked down the issues with rcache_rb we will
remove the above hacks.
This commit was SVN r7499.
2005-09-24 00:24:49 +00:00
Brian Barrett
50dc5499b4
* fix some remaining --with-btl-portals configure issues
...
This commit was SVN r7498.
2005-09-24 00:11:40 +00:00
Brian Barrett
0d68728b94
* add some more debugging output for send fragment issue to figure out why
...
Red Storm is complaining about invalid memory pointer (need to go back
to Linux and look at this with valgrind)
* Turn off send in place for now, so I can run the tests on RS and see if
everything else is ok
This commit was SVN r7497.
2005-09-23 19:30:54 +00:00
Brian Barrett
07b0b8c943
* add some useful debugging output
...
* fix dumb bug in btl_portals_get where I using the dest descriptor key instead
of the source descriptor key for the match bits, resulting in a PtlGet() with
the wrong match bits
This commit was SVN r7496.
2005-09-23 15:30:18 +00:00
Tim Woodall
604c9d1002
bump the default cache size
...
This commit was SVN r7492.
2005-09-22 19:37:42 +00:00
Tim Woodall
848f12e7fd
if mpi_leave_pinned is enabled - force malloc hooks
...
This commit was SVN r7491.
2005-09-22 17:27:56 +00:00
Tim Woodall
147716c249
added hostname to error output
...
This commit was SVN r7486.
2005-09-22 16:41:34 +00:00
Tim Woodall
b404581293
local variables/objects (regs) must be initialized/constructed
...
This commit was SVN r7485.
2005-09-22 16:18:23 +00:00
Tim Woodall
7acf0a6bdb
corrections for MPI_Free_mem
...
This commit was SVN r7481.
2005-09-22 15:47:33 +00:00
Andrew Friedley
555ae37255
Add lib{opal,orte,mpi}.la to appropriate LIBADD's, some whitespace cleanup as well.
...
This commit was SVN r7477.
2005-09-22 12:28:54 +00:00
Tim Woodall
da1e4a1292
- since we append new registrations to the end of the list,
...
need to remove old ones from the front
- call deregister to actually remove items from the cache/mru
list and deregister the memory (if not being used)
This commit was SVN r7476.
2005-09-21 23:25:16 +00:00
Tim Woodall
9791c066e8
dont attempt to pin the receive buffer if data has
...
already been received
This commit was SVN r7475.
2005-09-21 23:23:47 +00:00
Tim Woodall
1b7b220089
cleanup refcount
...
This commit was SVN r7462.
2005-09-21 20:04:56 +00:00
Tim Woodall
a74ca0062a
reductions to initial memory footprint
...
This commit was SVN r7455.
2005-09-21 19:10:56 +00:00
Galen Shipman
4296e723c9
default free_lists to smaller size..
...
This commit was SVN r7454.
2005-09-21 18:55:07 +00:00
Galen Shipman
96ab5a6bd3
we can be in WAITING_ACK state without a race if the OOB ack is "slower" than
...
the scheduling of queued IB send operations.
This commit was SVN r7452.
2005-09-21 16:47:08 +00:00
Tim Woodall
782e5b21cc
cleanup
...
This commit was SVN r7451.
2005-09-21 15:34:45 +00:00
Tim Woodall
a49a442fe4
cleanup refcount logic
...
This commit was SVN r7450.
2005-09-21 15:32:27 +00:00
Tim Woodall
0ee34051f8
debug asserts
...
This commit was SVN r7449.
2005-09-21 15:30:17 +00:00
Tim Woodall
1b73d3856e
possible race condition - set endpoint state before sending connect ack
...
This commit was SVN r7448.
2005-09-20 21:03:55 +00:00
Brian Barrett
fd9901f683
* shell of a portals PML, properly ompi_ignored for most of the world...
...
This commit was SVN r7437.
2005-09-20 08:07:08 +00:00
Brian Barrett
d81726833e
* Add memory barriers for shared memory. Rich and I think we got them
...
all and the Intel tests pass slightly oversubscribed.
This commit was SVN r7431.
2005-09-19 16:28:25 +00:00
Tim Woodall
aeb5bc3f57
still need to cleanup/revise the template for mpool changes
...
This commit was SVN r7425.
2005-09-19 14:34:24 +00:00
George Bosilca
b70230858b
Correct the misnaming problem in the GM PTL.
...
This commit was SVN r7424.
2005-09-19 10:34:06 +00:00
Galen Shipman
6499eb3976
init the return code..
...
This commit was SVN r7423.
2005-09-18 14:25:30 +00:00
George Bosilca
97673b45d1
Remove the last bad symbol from the GM PTL.
...
This commit was SVN r7422.
2005-09-18 12:52:37 +00:00
George Bosilca
b5cb27c006
The self should use self named files.
...
This commit was SVN r7421.
2005-09-18 12:37:15 +00:00
Jeff Squyres
d67c31f238
Remove useless compiler warnings.
...
This commit was SVN r7418.
2005-09-17 10:54:48 +00:00
Galen Shipman
b8cb6e1c64
modified mpool module to contain flags - used to determine if the mpool will
...
be used in MPI_Alloc_mem operations. Note that we found an interesting bug in
which if memory was allocated by the sm mpool (via mmap) and then registered
via the mvapi mpool, the registration would fail on certain systems.
Added mca param mpool_base_use_mem_hooks, set to 1 to enable the memory hooks
so that memory is deregistered if the user frees it behind our back. This is
only useful if the mca param mpi_leave_pinned is also set to 1. Otherwise all
registrations are deregistered within the MPI library or via
MPI_Free_buf. After testing we should probably set both mpi_leave_pinned and
mpool_base_use_mem_hooks to default to 1.
This commit was SVN r7415.
2005-09-16 22:22:03 +00:00
Galen Shipman
808b2c1c53
threaded build fix for btl_gm..
...
This commit was SVN r7409.
2005-09-16 17:18:15 +00:00
Jeff Squyres
2b82224a4f
Remove superflous ; (actually causes an error in some cases)
...
This commit was SVN r7405.
2005-09-16 12:27:25 +00:00
Jeff Squyres
10d02b2110
Make sure to copy the right amount out of the temp buffer.
...
This commit was SVN r7400.
2005-09-15 22:06:36 +00:00
Galen Shipman
22dac4983c
fix mca_mpool_base_free to use new rcache
...
This commit was SVN r7398.
2005-09-15 21:09:07 +00:00
Jeff Squyres
15d0a95202
- Remove extra whitespace from Makefile.am's from when we removed
...
Makefile.options
- Sample in each of the three projects of how to link againt the
relevant libraries so that when components are loaded into a parent
process' space, we don't rely on the libopal/liborte/libmpi symbols
being in the parent's public symbol namespace -- instead,
dynamically link to the relevant libraries, allowing the dynamic
linker to pull those libraries in at run-time, if needed
This commit was SVN r7397.
2005-09-15 20:56:18 +00:00
Tim Woodall
9b96ecf9b1
correction for rdma case - currently rdma entire message
...
This commit was SVN r7392.
2005-09-15 19:36:56 +00:00
Jeff Squyres
3ecfe02b83
- Properly handle MPI_IN_PLACE
...
- Return MPI_ERR_ARG, not EINVAL
This commit was SVN r7391.
2005-09-15 19:33:54 +00:00
Tim Woodall
6ae2ae4d1a
- code cleanup
...
- correct mpi semantics
This commit was SVN r7390.
2005-09-15 18:47:59 +00:00
Jeff Squyres
2c1186cd19
Fix up the offsets for the non-root gatherv in the IN_PLACE case.
...
This commit was SVN r7389.
2005-09-15 18:21:18 +00:00
George Bosilca
32cdc551af
No more warnings in the GM PTL.
...
This commit was SVN r7385.
2005-09-15 15:29:31 +00:00
Jeff Squyres
7ca22d9416
- Correct to use the right offsets
...
- Copy back to the right location in the non-rank-0-IN_PLACE case
This commit was SVN r7384.
2005-09-15 15:15:23 +00:00
Jeff Squyres
406f0575eb
- Remove useless error check
...
- Ensure err is set to MPI_SUCCESS on the IN_PLACE case
This commit was SVN r7383.
2005-09-15 15:14:00 +00:00
Jeff Squyres
cbfb062a7d
Fix silly mistake for IN_PLACE handling in scan
...
This commit was SVN r7380.
2005-09-15 12:47:17 +00:00
Jeff Squyres
068b9c72a2
Bunches of changes
...
- remove redundant OBJ_CONSTRUCT in bcast
- fix up some macros in coll_sm.h
- check to ensure that if there are too many processes in the
communicator (i.e., if we couldn't fit a flag for each of them in
the control segment), then fail selection
- setup the in_use flags properly
- adapt to new mpool API
- first working copy of reduce -- not tree-baed (but still
NUMA-aware), and only processes in order from process 0 to process
N-1 -- do not have a tree-based and/or commutative version yet
(i.e., process the results in whatever order they arrive)
Reduce now passes the new ibm reduce_big.c test. Woo hoo! Time to
declare success for the evening (and run the intel test tomorrow).
This commit was SVN r7379.
2005-09-15 02:18:16 +00:00
Tim Woodall
31d392af95
correct name
...
This commit was SVN r7376.
2005-09-14 22:35:58 +00:00
Tim Woodall
6ffa947a85
dont try and use convertor if not initialized
...
This commit was SVN r7375.
2005-09-14 22:03:52 +00:00
Tim Woodall
d190e6a315
handle losing a connection
...
This commit was SVN r7373.
2005-09-14 21:27:30 +00:00
Tim Woodall
c25fb5dab0
- fixed issue w/ btl send-in-place option that was affecting tcp
...
- reduced size of match header by an additional 4 bytes to 16 bytes
- corrections for buffered send (work in progress)
This commit was SVN r7371.
2005-09-14 17:08:08 +00:00
Brian Barrett
e98415eb7b
* make tree compile on OS X
...
This commit was SVN r7370.
2005-09-14 15:52:42 +00:00
Galen Shipman
8b146cec13
Callback shouldn't be static as it is used in more than one .c file.
...
This commit was SVN r7369.
2005-09-14 13:27:09 +00:00
Jeff Squyres
5365ae84b9
Remove extra variable. Still working with George / Edgar on
...
reduce_log_intra().
This commit was SVN r7368.
2005-09-14 11:52:20 +00:00
Jeff Squyres
5456d3444f
- Add missing header files
...
- Use new #include file scheme
This commit was SVN r7367.
2005-09-14 09:37:20 +00:00
Galen Shipman
f0b1ea52bc
if all else fails in prepare_src,, pack
...
init the rdma_pending list in ob1
This commit was SVN r7366.
2005-09-14 04:41:33 +00:00
Galen Shipman
940a2494a2
init the find, release, and retain funcs on the mpool, otherwise segfault..
...
This commit was SVN r7365.
2005-09-14 02:59:31 +00:00
Jeff Squyres
e0c47dd0bc
Fix for allreduce in IN_PLACE cases
...
This commit was SVN r7364.
2005-09-14 02:42:32 +00:00
Jeff Squyres
0fcd682c4c
MPI-2 7.3.3 description of MPI_Allgatherv is wrong -- can't just have
...
all processes call MPI_Gatherv(MPI_IN_PLACE...) because IN_PLACE is
only allowed to be used at the root. Non-root processes must use
their receive buf as the send buf.
This commit was SVN r7363.
2005-09-14 02:21:33 +00:00
Galen Shipman
b3db6fc2d1
Add code for mem_free hooks, commented out right now as there are performance
...
issues.
In PML-OB1 - fix for sync-sends of zero length.
This commit was SVN r7362.
2005-09-14 02:17:04 +00:00
Galen Shipman
272153cd47
fix threaded build issues with rcache.
...
This commit was SVN r7358.
2005-09-13 22:06:44 +00:00
Graham Fagg
0f75381e56
Added various barrier routines: recursive doubling, bruck, double ring, 2proc etc
...
all pass tests
This commit was SVN r7355.
2005-09-13 20:58:42 +00:00
Brian Barrett
1290b8eed2
* some debugging to figure out why get isn't working on RS
...
This commit was SVN r7354.
2005-09-13 20:52:56 +00:00
George Bosilca
ad0c0cdc03
Make the GM btl compile again. There were just some typos.
...
This commit was SVN r7352.
2005-09-13 20:19:21 +00:00
Jeff Squyres
5dca18f903
First cut of handling MPI_IN_PLACE:
...
- added relevant logic for everything except
mca_coll_basic_reduce_log_intra() -- need some help from George /
Edgar on this one...
- replaced ompi_ddt_sndrcv() with ompi_ddt_copy_content_same_ddt()
where relevant
- removed some "if (size > 1)" conditionals, because the self coll
module will always be chosen for collectives where size==1
Waiting for BA's tests to check the validity of this IN_PLACE stuff.
We'll see how it goes!
This commit was SVN r7351.
2005-09-13 20:06:54 +00:00
Jeff Squyres
bd95f5d474
Arrgh -- check the right argument for IN_PLACE.
...
This commit was SVN r7350.
2005-09-13 19:56:43 +00:00
Jeff Squyres
7c09923751
Updates:
...
- Handle MPI_IN_PLACE
- Use ompi_ddt_copy_content_same_ddt() where relevant
This commit was SVN r7349.
2005-09-13 19:39:49 +00:00
Graham Fagg
9053790973
fixed bruck alltoall bug. now passes ibm tests
...
This commit was SVN r7346.
2005-09-13 18:35:45 +00:00
Jeff Squyres
47a1a2b7ec
Arrgh. Compile *before* commit.
...
Sorry folks -- stupid typo fixed.
This commit was SVN r7345.
2005-09-13 18:12:10 +00:00
Jeff Squyres
da87169d17
Add support for MPI_IN_PLACE for the easy operations.
...
This commit was SVN r7344.
2005-09-13 18:02:36 +00:00
Tim Woodall
ee58631c82
corrections for probe/iprobe
...
This commit was SVN r7342.
2005-09-13 16:45:41 +00:00
Jeff Squyres
bbae6c3b1a
Add missing header file
...
This commit was SVN r7338.
2005-09-13 12:19:34 +00:00
Graham Fagg
f354140587
Multiple changes
...
-added some alltoall calls (pairwise checked ok, bruck testing)
-changes in use of data hung of communicator
-making sendrecv call a true inline function
-more use ompi_ddt routines
This commit was SVN r7337.
2005-09-13 04:28:18 +00:00
Tim Woodall
bacc1b9122
hack to request all existing values for jobids other
...
than our own - required for mpi2 dynamic processes
This commit was SVN r7336.
2005-09-13 03:53:53 +00:00
Galen Shipman
39f25428da
missing includes, perhaps related to george's work?
...
This commit was SVN r7332.
2005-09-13 02:00:28 +00:00
Galen Shipman
d932cfd342
merge of rcache work into the trunk.. lotsa fun ;-)..
...
I regression tested before the merge, I will regression test tonight and
correct issues that might have crept in.
This commit was SVN r7329.
2005-09-12 22:28:23 +00:00
Brian Barrett
4c62c356c7
* more missing header file recovery
...
This commit was SVN r7328.
2005-09-12 22:13:09 +00:00
George Bosilca
8308ab42e9
GM depend on the proc.h now.
...
This commit was SVN r7327.
2005-09-12 21:52:44 +00:00
Brian Barrett
88cd561198
* bunch of fixes for Red Storm - missing header files and the like
...
This commit was SVN r7325.
2005-09-12 21:45:58 +00:00
Tim Woodall
304f6254e6
additional btl flags
...
This commit was SVN r7324.
2005-09-12 21:38:31 +00:00
Brian Barrett
79f7ea6856
* implement btl_put for Portals
...
This commit was SVN r7320.
2005-09-12 20:24:43 +00:00
George Bosilca
c9fb1f32f2
And more dependencies fixes. The big commit will follow shortly.
...
This commit was SVN r7319.
2005-09-12 20:22:59 +00:00
George Bosilca
fd1431bf0f
Dependencies fixes.
...
This commit was SVN r7318.
2005-09-12 20:21:53 +00:00
George Bosilca
6eef57c5f2
More dependencies work.
...
This commit was SVN r7317.
2005-09-12 20:20:51 +00:00
George Bosilca
efac21256b
Add some more dependencies.
...
This commit was SVN r7316.
2005-09-12 20:19:46 +00:00
George Bosilca
13f4191334
Remove the gm_config.h file as now the GM defines are in the ompi_config.h.
...
Add some more header files for the next commit ... stay tuned ...
This commit was SVN r7315.
2005-09-12 19:55:21 +00:00
George Bosilca
1b031c153b
Last commit to make the threaded case compiling without warnings. Next step try to make it working ...
...
Correct the spring of the vpid problem (similar to the one in the SM PTL).
Add one more argument to the MCA_BTL_SM_FIFO_WRITE macro who will get passed down to the
MCA_BTL_SM_SIGNAL_PEER macro to allow it to have the fifo_fd file descriptor.
This commit was SVN r7305.
2005-09-11 20:55:22 +00:00
George Bosilca
f0e4cacd4d
procs[proc]->proc_name.vpid is a size_t, so try to cast it before using sprintf.
...
This commit was SVN r7304.
2005-09-11 20:52:02 +00:00
George Bosilca
f8d9f6121c
Typo correction ...
...
This commit was SVN r7303.
2005-09-11 20:49:27 +00:00
George Bosilca
8b1c28e068
No more warnings for the threaded case compilation. Some of the fields have to be declared
...
as volatile to make sure the compiler don't try to optimize them out.
This commit was SVN r7302.
2005-09-11 20:48:37 +00:00
George Bosilca
e501768f10
Sleep is defined in the unistd.h file, do not forget to include it on the dependencies list.
...
This commit was SVN r7301.
2005-09-11 20:05:17 +00:00
George Bosilca
c24eb702bb
Correctly compute the default sizes for the fragments.
...
This commit was SVN r7299.
2005-09-11 20:02:55 +00:00
George Bosilca
2e3764a181
Remove the unused variable p + something that SVN figure out and where I dont see any difference,
...
certainly just some conversion from TAB to space ...
This commit was SVN r7287.
2005-09-10 04:06:49 +00:00
Graham Fagg
00842ad87c
Fixed reduce bugs
...
(added some temp debug routines)
This commit was SVN r7283.
2005-09-09 23:05:17 +00:00
George Bosilca
0ad973afdd
Do not modex sned and receive the proc architecture. This is now done outside the PML in the proc
...
init and was added there few weeks ago by Ralph.
This commit was SVN r7282.
2005-09-09 22:21:57 +00:00
Jeff Squyres
e8da20a6ae
Fix VPATH build
...
This commit was SVN r7281.
2005-09-09 22:20:37 +00:00
Jeff Squyres
4aa75fa739
- Make opal_output_stream_t be a real opal_object_t so that it can use
...
a constructor, like the rest of the code base
- Convert usage in the tree to use the constructor to zero out an
instance of opal_output_stream_t
- Still need to re-enable output files
This commit was SVN r7253.
2005-09-09 10:46:54 +00:00
Jeff Squyres
8ec6721f24
Prior fix for the ROMIO re-#define problem didn't really fix the
...
problem because Autoconf replaced the "#undef ..." with "#define
...". Fix this by not putting the "#undef ..." statement directly in
romioconf.h[.in] -- but rather having romioconf.h[.in] #include
romioconf-undefs.h, which has the #undef statements.
This commit was SVN r7252.
2005-09-09 10:33:04 +00:00
Graham Fagg
9596d6e2f3
use correct names or cannot call functions...
...
use correct ddt calls (and params ext vs lb etc)
This commit was SVN r7243.
2005-09-09 02:39:57 +00:00
Galen Shipman
e2186a1cc2
Updates to the rb rcache..
...
This commit was SVN r7238.
2005-09-08 21:34:26 +00:00
Galen Shipman
ec2b99986f
remove rcache_base_init.c no longer needed..
...
This commit was SVN r7237.
2005-09-08 16:31:17 +00:00
Jeff Squyres
e8b120fbf2
- Add some #undef's so that we don't conflict with the
...
AC-automatically-generated macros
- Remove a useless #include
This commit was SVN r7228.
2005-09-08 09:42:19 +00:00
Galen Shipman
6c8e9ab661
more rcache changes
...
This commit was SVN r7227.
2005-09-07 20:37:17 +00:00
Galen Shipman
a0b82acece
Add fleshed out open,create and close
...
This commit was SVN r7226.
2005-09-07 20:21:15 +00:00
Jeff Squyres
b31c2f8e77
Remove unnecessary AM_CPPFLAGS
...
This commit was SVN r7221.
2005-09-07 18:40:56 +00:00
George Bosilca
105595bd08
Make rcache look like a component. The problem is that on MAC OS X ar is more sensitive
...
than other Unix OS's and does not accept to be called with any arguments. Therefore,
we need these files in order to succesfully compile even if they are empty.
This commit was SVN r7220.
2005-09-07 18:09:04 +00:00
George Bosilca
23cb29aefe
The src directory is not used anymore but it's still present in the configure.params file. Anyway I don't think this file is used as the .h file does not exist ...
...
This commit was SVN r7219.
2005-09-07 17:16:41 +00:00
Jeff Squyres
881851604b
Update the docs on the actual algorithms used
...
This commit was SVN r7216.
2005-09-07 15:46:33 +00:00
Tim Woodall
59f2462ef0
corrections/clarifications
...
This commit was SVN r7215.
2005-09-07 13:40:22 +00:00
Jeff Squyres
9302f924ea
simplify the bcast code by taking abstract actions and making them
...
macros -- will help with the other algorithms
This commit was SVN r7214.
2005-09-07 13:33:43 +00:00
Tim Woodall
3e002203a0
dont need to adjust size
...
This commit was SVN r7213.
2005-09-07 13:25:05 +00:00
Brian Barrett
ed56e743b7
* update configure.ac to use the modern version of AC_INIT and
...
AM_INIT_AUTOMAKE, instead of the deprecated version.
* Work around dumbness in modern AC_INIT that requires the version
number to be set at autoconf time (instead of at configure time, as
it was before). Set the version number, minus the subversion r number,
at autoconf time. Override the internal variables to include the r
number (if needed) at configure time. Basically, the right thing
should always happen. The only place it might not is the version
reported as part of configure --help will not have an r number.
* Since AM_INIT_AUTOMAKE taks a list of options, no need to specify
them in all the Makefile.am files.
* Addes support for subdir-objects, meaning that object files are put
in the directory containing source files, even if the Makefile.am is
in another directory. This should start making it feasible to
reduce the number of Makefile.am files we have in the tree, which
will greatly reduce the time to run autogen and configure.
This commit was SVN r7211.
2005-09-07 05:54:53 +00:00
Jeff Squyres
7bab4ed269
bunches of updates
...
- finally added "in use" flags -- one flag protects a set of segments
- these flags now used in bcast to protect (for example) when a
message is so long that the root loops around the segments and has
to re-use old segments -- now it knows that it has to wait until the
non-root processes have finished with that set of segments before it
can start using them
- implement allreduce as a reduce followed by a bcast (per discussion
with rich)
- removed some redundant data on various data structures
- implemented query MCA param ("coll_sm_shared_mem_used_data") that
tells you how much shared memory will be used for a given set of MCA
params (e.g., number of segments, etc.). For example:
ompi_info --mca coll_sm_info_num_procs 4 --param coll sm | \
grep shared_mem_used_data
tells you that for the default MCA param values (as of r7172), for 4
processes, sm will use 548864 bytes of shared memory for its data
transfer section
- remove a bunch of .c files from the Makefile.am that aren't
implemented yet (i.e., all they do is return ERR_NOT_IMPLEMENTED)
Now on to the big Altix to test that this stuff really works...
This commit was SVN r7205.
The following SVN revision numbers were found above:
r7172 --> open-mpi/ompi@bc72a7722b
2005-09-06 21:41:55 +00:00
Tim Woodall
7ccc43a052
correct for btls that don't support get
...
This commit was SVN r7201.
2005-09-06 19:01:35 +00:00
Tim Woodall
a3786c4579
dont attempt to deregister if not supported
...
This commit was SVN r7200.
2005-09-06 18:27:53 +00:00
Tim Woodall
d7d717af46
correction for case where registration not supported
...
This commit was SVN r7199.
2005-09-06 18:27:07 +00:00
Galen Shipman
e5ea1b55ef
fix for threaded build
...
This commit was SVN r7194.
2005-09-06 15:21:31 +00:00
Galen Shipman
a47cb00f84
fix bug in threaded build..
...
This commit was SVN r7193.
2005-09-06 14:37:46 +00:00
Graham Fagg
b97305bbcc
a few more functions (testing)
...
This commit was SVN r7190.
2005-09-06 05:21:57 +00:00
George Bosilca
5df64827c8
The MX BTL and PTL does not require the same version of the MX library. The BTL accept the
...
default version while the PTL require a patched version (iwith the mx_register_match_callback function).
This commit was SVN r7188.
2005-09-06 03:11:42 +00:00
Brian Barrett
6f19022db9
* Update Portals configuration to use --with-portals instead of
...
--with-btl-portals
* Update Red Storm build config file tomatch change
This commit was SVN r7185.
2005-09-05 21:02:50 +00:00
Galen Shipman
f541088bc3
typo broke the threaded build..
...
This commit was SVN r7182.
2005-09-05 16:43:01 +00:00
George Bosilca
3078be40aa
First stable version of the MX BTL (at least we pass NetPipe). The perfs are not amazing
...
but are not that bad either.
On a 2 procs Intel(R) Xeon(TM) CPU 3.20GHz with MYRICOM Inc. Myrinet 2000 Scalable Cluster Interconnect (rev 04) I get:
0: 1 bytes 13096 times --> 1.10 Mbps in 6.94 usec
1: 2 bytes 14408 times --> 2.17 Mbps in 7.02 usec
2: 3 bytes 14243 times --> 3.24 Mbps in 7.07 usec
3: 4 bytes 9428 times --> 4.27 Mbps in 7.15 usec
4: 6 bytes 10493 times --> 6.26 Mbps in 7.32 usec
5: 8 bytes 6834 times --> 8.18 Mbps in 7.47 usec
6: 12 bytes 8371 times --> 11.89 Mbps in 7.70 usec
7: 13 bytes 5411 times --> 12.72 Mbps in 7.80 usec
8: 16 bytes 5919 times --> 15.35 Mbps in 7.95 usec
9: 19 bytes 7074 times --> 17.66 Mbps in 8.21 usec
10: 21 bytes 7696 times --> 19.00 Mbps in 8.43 usec
11: 24 bytes 7906 times --> 20.87 Mbps in 8.77 usec
12: 27 bytes 8073 times --> 23.05 Mbps in 8.94 usec
13: 29 bytes 4972 times --> 24.32 Mbps in 9.10 usec
14: 32 bytes 5307 times --> 26.29 Mbps in 9.29 usec
15: 35 bytes 5720 times --> 33.61 Mbps in 7.95 usec
16: 45 bytes 7191 times --> 39.50 Mbps in 8.69 usec
17: 48 bytes 7670 times --> 41.33 Mbps in 8.86 usec
18: 51 bytes 7759 times --> 42.80 Mbps in 9.09 usec
19: 61 bytes 4313 times --> 47.44 Mbps in 9.81 usec
20: 64 bytes 5012 times --> 57.61 Mbps in 8.48 usec
21: 67 bytes 6083 times --> 59.31 Mbps in 8.62 usec
22: 93 bytes 6234 times --> 68.08 Mbps in 10.42 usec
23: 96 bytes 6396 times --> 80.65 Mbps in 9.08 usec
24: 99 bytes 7455 times --> 81.56 Mbps in 9.26 usec
25: 125 bytes 3926 times --> 112.46 Mbps in 8.48 usec
26: 128 bytes 5848 times --> 116.87 Mbps in 8.36 usec
27: 131 bytes 6077 times --> 119.22 Mbps in 8.38 usec
28: 189 bytes 6192 times --> 163.79 Mbps in 8.80 usec
29: 192 bytes 7572 times --> 168.01 Mbps in 8.72 usec
30: 195 bytes 7705 times --> 171.13 Mbps in 8.69 usec
31: 253 bytes 4011 times --> 210.21 Mbps in 9.18 usec
32: 256 bytes 5423 times --> 214.55 Mbps in 9.10 usec
33: 259 bytes 5535 times --> 217.64 Mbps in 9.08 usec
34: 381 bytes 5613 times --> 290.55 Mbps in 10.00 usec
35: 384 bytes 6663 times --> 296.11 Mbps in 9.89 usec
36: 387 bytes 6764 times --> 298.74 Mbps in 9.88 usec
37: 509 bytes 3451 times --> 353.78 Mbps in 10.98 usec
38: 512 bytes 4546 times --> 359.36 Mbps in 10.87 usec
39: 515 bytes 4617 times --> 361.53 Mbps in 10.87 usec
40: 765 bytes 4645 times --> 461.41 Mbps in 12.65 usec
41: 768 bytes 5270 times --> 468.59 Mbps in 12.50 usec
42: 771 bytes 5341 times --> 470.16 Mbps in 12.51 usec
43: 1021 bytes 2695 times --> 508.42 Mbps in 15.32 usec
44: 1024 bytes 3260 times --> 514.44 Mbps in 15.19 usec
45: 1027 bytes 3298 times --> 515.72 Mbps in 15.19 usec
46: 1533 bytes 3307 times --> 707.12 Mbps in 16.54 usec
47: 1536 bytes 4030 times --> 714.93 Mbps in 16.39 usec
48: 1539 bytes 4071 times --> 714.41 Mbps in 16.44 usec
49: 2045 bytes 2040 times --> 761.38 Mbps in 20.49 usec
50: 2048 bytes 2438 times --> 769.78 Mbps in 20.30 usec
51: 2051 bytes 2465 times --> 769.78 Mbps in 20.33 usec
52: 3069 bytes 2465 times --> 923.43 Mbps in 25.36 usec
53: 3072 bytes 2629 times --> 928.48 Mbps in 25.24 usec
54: 3075 bytes 2642 times --> 929.07 Mbps in 25.25 usec
55: 4093 bytes 1323 times --> 1012.38 Mbps in 30.85 usec
56: 4096 bytes 1620 times --> 1016.69 Mbps in 30.74 usec
57: 4099 bytes 1627 times --> 1015.16 Mbps in 30.81 usec
58: 6141 bytes 1625 times --> 1171.82 Mbps in 39.98 usec
59: 6144 bytes 1667 times --> 1173.85 Mbps in 39.93 usec
60: 6147 bytes 1669 times --> 1174.44 Mbps in 39.93 usec
61: 8189 bytes 835 times --> 1232.43 Mbps in 50.69 usec
62: 8192 bytes 986 times --> 1234.87 Mbps in 50.61 usec
63: 8195 bytes 988 times --> 1234.85 Mbps in 50.63 usec
64: 12285 bytes 988 times --> 1360.73 Mbps in 68.88 usec
65: 12288 bytes 967 times --> 1364.20 Mbps in 68.72 usec
66: 12291 bytes 970 times --> 1364.56 Mbps in 68.72 usec
67: 16381 bytes 485 times --> 1385.48 Mbps in 90.21 usec
68: 16384 bytes 554 times --> 1388.76 Mbps in 90.01 usec
69: 16387 bytes 555 times --> 1388.41 Mbps in 90.05 usec
70: 24573 bytes 555 times --> 1499.72 Mbps in 125.01 usec
71: 24576 bytes 533 times --> 1499.36 Mbps in 125.05 usec
72: 24579 bytes 533 times --> 1500.44 Mbps in 124.98 usec
73: 32765 bytes 266 times --> 1499.31 Mbps in 166.73 usec
74: 32768 bytes 299 times --> 1497.10 Mbps in 166.99 usec
75: 32771 bytes 299 times --> 1495.29 Mbps in 167.21 usec
76: 49149 bytes 299 times --> 1528.78 Mbps in 245.28 usec
77: 49152 bytes 271 times --> 1527.97 Mbps in 245.42 usec
78: 49155 bytes 271 times --> 1529.35 Mbps in 245.22 usec
79: 65533 bytes 135 times --> 1586.19 Mbps in 315.21 usec
80: 65536 bytes 158 times --> 1591.11 Mbps in 314.25 usec
81: 65539 bytes 159 times --> 1586.50 Mbps in 315.17 usec
82: 98301 bytes 158 times --> 1668.05 Mbps in 449.61 usec
83: 98304 bytes 148 times --> 1667.40 Mbps in 449.80 usec
84: 98307 bytes 148 times --> 1667.29 Mbps in 449.84 usec
85: 131069 bytes 74 times --> 1709.11 Mbps in 585.09 usec
86: 131072 bytes 85 times --> 1711.09 Mbps in 584.42 usec
87: 131075 bytes 85 times --> 1710.92 Mbps in 584.49 usec
88: 196605 bytes 85 times --> 1727.93 Mbps in 868.08 usec
89: 196608 bytes 76 times --> 1726.28 Mbps in 868.92 usec
90: 196611 bytes 76 times --> 1727.06 Mbps in 868.54 usec
91: 262141 bytes 38 times --> 1757.65 Mbps in 1137.87 usec
92: 262144 bytes 43 times --> 1758.69 Mbps in 1137.21 usec
93: 262147 bytes 43 times --> 1759.38 Mbps in 1136.78 usec
94: 393213 bytes 43 times --> 1801.51 Mbps in 1665.25 usec
95: 393216 bytes 40 times --> 1803.26 Mbps in 1663.65 usec
96: 393219 bytes 40 times --> 1800.73 Mbps in 1666.00 usec
97: 524285 bytes 20 times --> 1805.33 Mbps in 2215.65 usec
98: 524288 bytes 22 times --> 1806.80 Mbps in 2213.86 usec
99: 524291 bytes 22 times --> 1805.77 Mbps in 2215.14 usec
100: 786429 bytes 22 times --> 1827.24 Mbps in 3283.64 usec
101: 786432 bytes 20 times --> 1827.03 Mbps in 3284.03 usec
102: 786435 bytes 20 times --> 1827.20 Mbps in 3283.73 usec
103: 1048573 bytes 10 times --> 1840.05 Mbps in 4347.71 usec
104: 1048576 bytes 11 times --> 1839.68 Mbps in 4348.58 usec
105: 1048579 bytes 11 times --> 1840.13 Mbps in 4347.54 usec
106: 1572861 bytes 11 times --> 1853.99 Mbps in 6472.50 usec
107: 1572864 bytes 10 times --> 1854.11 Mbps in 6472.10 usec
108: 1572867 bytes 10 times --> 1854.12 Mbps in 6472.10 usec
109: 2097149 bytes 5 times --> 1861.41 Mbps in 8595.61 usec
110: 2097152 bytes 5 times --> 1861.25 Mbps in 8596.40 usec
111: 2097155 bytes 5 times --> 1860.99 Mbps in 8597.59 usec
112: 3145725 bytes 5 times --> 1868.34 Mbps in 12845.59 usec
113: 3145728 bytes 5 times --> 1868.30 Mbps in 12845.90 usec
114: 3145731 bytes 5 times --> 1868.59 Mbps in 12843.89 usec
115: 4194301 bytes 3 times --> 1872.16 Mbps in 17092.51 usec
116: 4194304 bytes 3 times --> 1872.31 Mbps in 17091.19 usec
117: 4194307 bytes 3 times --> 1872.13 Mbps in 17092.82 usec
118: 6291453 bytes 3 times --> 1875.88 Mbps in 25588.00 usec
119: 6291456 bytes 3 times --> 1875.98 Mbps in 25586.68 usec
120: 6291459 bytes 3 times --> 1875.93 Mbps in 25587.36 usec
121: 8388605 bytes 3 times --> 1877.79 Mbps in 34082.69 usec
122: 8388608 bytes 3 times --> 1877.72 Mbps in 34083.84 usec
123: 8388611 bytes 3 times --> 1877.66 Mbps in 34085.00 usec
This commit was SVN r7180.
2005-09-04 22:08:13 +00:00
Galen Shipman
1af92a1de2
tried to acquire wrong lock..
...
This commit was SVN r7177.
2005-09-04 13:26:46 +00:00
Galen Shipman
ba9342085e
Changes to support rcache in mpool
...
This commit was SVN r7176.
2005-09-04 04:20:55 +00:00
Galen Shipman
2314919b73
Initial checkin of rcache
...
This commit was SVN r7174.
2005-09-04 04:17:00 +00:00
Jeff Squyres
bc72a7722b
Updates:
...
- bcast now works properly for root!=0 and multi-fragment messages
- destroy mpool when communicator is destroyed
Still need to implement:
- "in use" flags for groups of fragments so that "wrapping around" in
the data segment doesn't overwrite not-yet-read data
- ensure that shared memory isn't removed before all processes have
finished with it (e.g., during COMM_FREE)
This commit was SVN r7172.
2005-09-03 11:49:46 +00:00
Graham Fagg
059d7f26f8
re-enable proper freeing of allocated structures now that I know these
...
are not causing an error.
This commit was SVN r7170.
2005-09-03 06:19:17 +00:00
Graham Fagg
35447d4c32
underfilling of a only segment and the doing a PML send and esp a recv on it can
...
cause flipping hard to find memory errors...
This commit was SVN r7169.
2005-09-03 06:14:03 +00:00
Graham Fagg
36eddb6609
checkpoint
...
This commit was SVN r7168.
2005-09-03 01:41:13 +00:00
Jeff Squyres
99c3edab67
Added mca_mpool_base_module_destroy() function so that you can destroy
...
an mpool module before MPI_FINALIZE (i.e., ompi_mpi_finalize())
This commit was SVN r7165.
2005-09-03 00:07:34 +00:00
Tim Woodall
b65dc08ab1
counters need to be signed as we check for <0
...
This commit was SVN r7155.
2005-09-02 18:26:07 +00:00
Tim Woodall
dfe52fceef
minor changes to thread locking
...
This commit was SVN r7154.
2005-09-02 16:27:01 +00:00
Galen Shipman
589b1b8b5a
Additional changes to add_proc and tokens
...
This commit was SVN r7152.
2005-09-02 15:18:36 +00:00
Tim Woodall
4fbf7965e3
check for rdma btls when leave pinned is set
...
This commit was SVN r7151.
2005-09-02 15:04:47 +00:00
Jeff Squyres
647f6a7648
Update data structures
...
This commit was SVN r7150.
2005-09-02 14:53:14 +00:00
Jeff Squyres
6ef4805729
Tree-based barrier and broadcast seem to be working. Now on to reduce
...
/ allreduce...
This commit was SVN r7149.
2005-09-02 12:57:47 +00:00
Jeff Squyres
560f323048
Update to ensure that the macros AC_REQUIRE'd by AC_CHECK_HEADER are
...
always invoked properly.
This commit was SVN r7147.
2005-09-02 11:01:07 +00:00
Galen Shipman
a7a4da4502
Scale the SRQ based on the log base 2 of the number of peers,
...
this assumes that the peers have all been added via add_procs up front.
Bad things will happen if add_procs is called again later on a new set of
procs to fix this we need to modify the srq which may wreck things.. looking
into this deeper..
This commit was SVN r7142.
2005-09-02 04:06:51 +00:00
Galen Shipman
c8a23106c0
More fixes for sq tokens,
...
Additional work on multi-rail support.
This commit was SVN r7139.
2005-09-02 03:04:28 +00:00
Graham Fagg
25787c4ca7
added segmented binary
...
renamed split so we know its a split binary tree
(tested, chain/bin/splitbin all pass simple and ibm tests)
This commit was SVN r7138.
2005-09-02 02:19:59 +00:00
Graham Fagg
a7a20e1a57
corrected first seg recv for intermediate nodes (or else we lose a request)
...
This commit was SVN r7137.
2005-09-02 00:55:47 +00:00
Graham Fagg
d78e9d0e9e
get/handle extent correctly
...
last rank in comm is not always last in tree structure for nonzero roots
This commit was SVN r7135.
2005-09-01 22:56:47 +00:00
Graham Fagg
f4de8776a6
ops
...
This commit was SVN r7133.
2005-09-01 17:12:28 +00:00
Tim Woodall
636ab23fdb
atomic increment/test
...
This commit was SVN r7130.
2005-09-01 15:09:50 +00:00
Ralph Castain
03e45e6723
Two quick additions:
...
1. Added OMPI_PROC_ARCH as a defined registry key and added the code so that the architecture info gets properly transmitted across all processes using the startup message.
2. Added an OMPI_MODEX_KEY definition and removed the hard-coded "modex" key from pml_modex_exchange
This commit was SVN r7129.
2005-09-01 15:05:03 +00:00
Jeff Squyres
3962c53e2e
- Add to AM_CPPFLAGS $(OPAL_LTDL_CPPFLAGS) where necessary in order to
...
add a -I to find the included ltdl.h (vs. a system-installed ltdl.h)
- Clean up kruft in a bunch of Makefile.am's to remove now-unnecessary
AM_CPPFLAGS settings to get static-components.h for each framework
- Move the component_repository API functions out of opal/mca/base/base.h
and into opal/mca/base/mca_base_component_repository.h in order to
decrease unnecessary dependencies (e.g., before this, almost
everything in the tree depended on ltdl.h, which is unnecessary --
only a small number of files really need ltdl.h)
This commit was SVN r7127.
2005-09-01 12:16:36 +00:00
George Bosilca
abadd5a984
Oops typo ...
...
This commit was SVN r7123.
2005-09-01 03:41:15 +00:00
George Bosilca
414e8fabad
mx_* functions return MX_* error codes ...
...
This commit was SVN r7122.
2005-09-01 03:40:48 +00:00
Galen Shipman
29f7b4deda
Changed send tokens to both send/rdma tokens for both low and high priority
...
queue pairs. Tested on intel p2p with 16 procs - Passed.
This commit was SVN r7119.
2005-09-01 02:41:44 +00:00
Ralph Castain
96f4bb7a63
Hey, sports fans!! Guess what??
...
Here's the huge registry check-in you've all been waiting for with baited breath. The revised version sends a single message to all processes at the various stage gates, thus making the startup much more scalable. I could provide you with all the tawdry details, but won't for now - you are welcome to ask, though, and I'll merrily bore your ears to tears.
In addition, the commit contains the following:
1. set the ignore properties on ompi/debuggers and orte/mca/pls/poe
2. Added simplified subscribe and put functions to the registry's API. I have also converted all of the ompi functions that registered subscriptions to the new API, and caught their associated put's as well.
In a follow-on commit, I'll be adding support for George's hetero arch registry subscription (wanted to get this one in first).
This commit was SVN r7118.
2005-09-01 01:07:30 +00:00
Graham Fagg
4ac2445c61
Various clean ups
...
Changed component so choice of decision functions controlled by mca params
(for now fixed decision functions (if statements) default)
started fixes for the various bcasts
This commit was SVN r7117.
2005-08-31 23:38:09 +00:00
Galen Shipman
c7e9563377
Added sender side per qp send tokens to limit the number of outstanding
...
sends.
This commit was SVN r7112.
2005-08-31 20:28:42 +00:00
Galen Shipman
4556f5bb7c
Fix for multiple calls to add_procs
...
This commit was SVN r7111.
2005-08-31 19:44:28 +00:00
Galen Shipman
09873f299f
Fixed a race in connection establishment..
...
This commit was SVN r7110.
2005-08-31 19:43:22 +00:00
Graham Fagg
1caec16018
snapshot as I move machines
...
do not use
This commit was SVN r7103.
2005-08-31 01:43:48 +00:00
Tim Woodall
47b41c7081
correct regression
...
This commit was SVN r7098.
2005-08-30 19:38:56 +00:00
Galen Shipman
00e0ff729d
intialize free list to rr_buf_max, report async errors to user.
...
This commit was SVN r7095.
2005-08-30 16:44:38 +00:00
Jeff Squyres
10488b717a
More 0 count fixes.
...
This commit was SVN r7083.
2005-08-29 19:55:48 +00:00
Jeff Squyres
0ef7ced8f0
For items with 0 receive counts, don't try to receive.
...
This commit was SVN r7082.
2005-08-29 19:37:07 +00:00
Tim Woodall
d34e299829
correctly decrement progress_event if tcp is not being
...
used so that tcp doesn't impact progress loop
This commit was SVN r7078.
2005-08-29 17:29:58 +00:00
George Bosilca
12c09fef92
PTL GM now use the new configure system (m4 macros).
...
This commit was SVN r7070.
2005-08-28 01:38:58 +00:00
Brian Barrett
173e062fbb
* Spell LIBS as LIBS not LIBX ;)
...
This commit was SVN r7069.
2005-08-27 17:38:50 +00:00
Jeff Squyres
9d6c22b0d5
Commit 2 of 2 to shorten romio component filenames: change the sym
...
links from mca_io_romio_dist_* to io_romio_*
This commit was SVN r7066.
2005-08-27 15:33:42 +00:00
Jeff Squyres
8006b1a5a8
Part 1 of 2 of a commit to reduce filenames in the romio component
...
(because we kept bumping up against the max filename limit in "tar"
when making tarballs, especially if the version number got long).
This commit was SVN r7065.
2005-08-27 15:17:25 +00:00
Tim Woodall
2a9ab3eb10
move obj construct back into open
...
This commit was SVN r7057.
2005-08-26 20:28:42 +00:00
Tim Woodall
5ed6f2c474
change flag to a sensible value
...
This commit was SVN r7056.
2005-08-26 20:21:07 +00:00
Tim Woodall
d57f3e1662
cleanup - handle request/prepare of zero bytes as special case
...
This commit was SVN r7055.
2005-08-26 20:19:11 +00:00
Tim Woodall
47ee552220
can't mark request as complete until local completion as buffers point to user data
...
This commit was SVN r7054.
2005-08-26 20:18:16 +00:00
Galen Shipman
56f722c6c1
Removed all references to the old common/vapi stuff.
...
This commit was SVN r7029.
2005-08-25 15:04:22 +00:00
Brian Barrett
523fa13ed8
* don't include ompi_config.h in mpi.h. This was causing some not-so
...
friendly #defines to be included in mpi.h (even for users), such as
_GNU_SOURCE, which can have some really big consequences on Linux.
Instead, add mpi.h to AC_CONFIG_HEADERS and just include the #defines
we have to have for mpi.h and the C++ bindings.
This commit was SVN r7022.
2005-08-25 00:41:26 +00:00
Galen Shipman
8c85aaf85a
tell the user no mvapi modules are found..
...
This commit was SVN r7016.
2005-08-24 21:59:55 +00:00
Jeff Squyres
d6819618ff
Minor updates
...
- Fix compiler warnings
- Fix problem with using "p" instead of "p_index"
- Style updates
- Check return of malloc() for NULL
This commit was SVN r6999.
2005-08-24 10:39:23 +00:00
Galen Shipman
53a0b37946
free the descriptor, don't cache it.
...
This commit was SVN r6991.
2005-08-23 23:49:07 +00:00
Tim Woodall
08a90e4318
work in progress
...
This commit was SVN r6990.
2005-08-23 23:05:01 +00:00
Jeff Squyres
ea45b150b6
Now pre-compute some things rather than compute them during every
...
barrier
This commit was SVN r6988.
2005-08-23 22:02:28 +00:00
Tim Woodall
e4fd117f5f
This commit was SVN r6986.
2005-08-23 21:30:42 +00:00
Jeff Squyres
31065f1cc0
First cut of sm coll component infrastrcutre (this is what took so
...
much time) and somewhat-lame implementation of barrier (need to
precompute some more stuff rather than calculate it every time).
Checkpointing so I can try this on another machine...
This commit was SVN r6985.
2005-08-23 21:22:00 +00:00
Tim Woodall
5a399e8150
default to using new BTLs "-mca pml ob1" rather than older ptls
...
This commit was SVN r6984.
2005-08-23 20:21:44 +00:00
Brian Barrett
1241645166
* don't ignore Portals BTL anymore
...
This commit was SVN r6971.
2005-08-22 03:52:07 +00:00
Brian Barrett
8d15ee8b2f
* remove pml direct call header file as part of make distclean
...
* remove output files for tests as part of make clean
This commit was SVN r6966.
2005-08-21 23:48:12 +00:00
Tim Woodall
205af3af0a
correct segment address
...
This commit was SVN r6942.
2005-08-19 20:20:27 +00:00
Galen Shipman
afdfa70f73
Added support for openib RDMA READ.. note that performance is currently an
...
issue so PUT is default.. We are determining if this is an openib issue or a
btl issue as we have seen performance increases on mvapi.
This commit was SVN r6928.
2005-08-18 17:08:27 +00:00
Tim Woodall
166ecc9544
removed dependency on ob1
...
This commit was SVN r6927.
2005-08-18 17:06:59 +00:00
Tim Woodall
95bf77fc8d
corrections for rdma pipeline
...
This commit was SVN r6926.
2005-08-18 17:06:35 +00:00
Jeff Squyres
a9777f902a
Move all the ptl sm source code out of src (the Makefile.am treated it
...
that way anway) so that we can properly "make distcheck" easier. Fix
the rule for making the sym link to ptl_sm_send_alternate.c so that
"distcheck" works.
This commit was SVN r6919.
2005-08-18 00:09:51 +00:00
Galen Shipman
589d53e828
only poll high priority qp 1 per progress.
...
This commit was SVN r6918.
2005-08-17 22:52:56 +00:00
Tim Woodall
f274f524ab
- added get based protocol (if supported by btl) for pre-registered memory
...
- removed 8 bytes from the majority of the pml headers
This commit was SVN r6916.
2005-08-17 18:23:38 +00:00
Jeff Squyres
da4d968c1b
Because the data structures are so confusing -- add some quick-n-dirty
...
slides showing what is pointing to what.
This commit was SVN r6910.
2005-08-16 21:56:48 +00:00
Galen Shipman
ee6999fa90
typo in threaded build..
...
This commit was SVN r6898.
2005-08-16 13:22:08 +00:00
Tim Woodall
dc3e8bf041
ack is not required if we are going to do rdma remainder of the message
...
This commit was SVN r6893.
2005-08-15 22:30:52 +00:00
Tim Woodall
adce576d5e
corrections for eager send of data in place
...
This commit was SVN r6892.
2005-08-15 21:31:52 +00:00
Tim Woodall
9a094ee3b4
- return corrected size
...
- set send inplace for eager send
This commit was SVN r6891.
2005-08-15 21:30:47 +00:00
Galen Shipman
f248db3789
misc fixes, changes to support multiple mvapi btl's
...
This commit was SVN r6890.
2005-08-15 19:39:56 +00:00
George Bosilca
cdee9045c1
ISO C90 forbids mixed declarations and code ...
...
This commit was SVN r6887.
2005-08-15 17:56:04 +00:00
Jeff Squyres
b080d7360c
Remove useless compiler warning
...
This commit was SVN r6886.
2005-08-15 16:48:43 +00:00
Galen Shipman
0b0e4874d0
cleanup comments and minor adjustments.
...
This commit was SVN r6882.
2005-08-15 15:19:07 +00:00
Brian Barrett
e5eba51e9f
* update rdma min size to be 64K. Seems to give best performance on RS.
...
This commit was SVN r6880.
2005-08-15 13:30:35 +00:00
Jeff Squyres
c465eb8567
Rename opal/threads/thread.h -> opal/threads/threads.h to avoid a
...
naming conflict with Solaris' <thread.h>
This commit was SVN r6879.
2005-08-15 11:02:01 +00:00
Brian Barrett
b9452e5afe
* finish switch to sending in place
...
This commit was SVN r6876.
2005-08-15 02:31:45 +00:00
Galen Shipman
adb20d6fcf
fix sync send..
...
This commit was SVN r6875.
2005-08-14 22:10:08 +00:00
Galen Shipman
8e1e2eec3d
Misc fixes for threaded builds..
...
This commit was SVN r6874.
2005-08-14 19:03:09 +00:00
Brian Barrett
ffd16db795
* fix missing continuation character in r2 when building threaded
...
This commit was SVN r6870.
The following SVN revision numbers were found above:
r2 --> open-mpi/ompi@58fdc18855
2005-08-14 15:31:27 +00:00
Brian Barrett
f273d84b1b
* update ob1 to direct call
...
* don't know what I was thinking, but can't use the MCA_PML_CALL macro on
the two data values, as they don't have things that the macro can
expand into
This commit was SVN r6868.
2005-08-14 03:14:20 +00:00
Brian Barrett
f68ede1c93
* turn off debugging in the bowels of the Portals reference implementation
...
This commit was SVN r6864.
2005-08-14 02:05:23 +00:00
Brian Barrett
51531af9df
* implement Portals btl get
...
This commit was SVN r6862.
2005-08-13 20:55:29 +00:00
Brian Barrett
8aca9ef966
* remove need to edit project/Makefile.am and project/{dynamic-,}mca/Makefile.am when adding a new component. Configure / autogen now do it for you.
...
* Add base to memory framework so that we can do something sane with
ompi_info
* Updated ompi_info to print components for memory framework and
show whether we have memory hooks active or not.
This commit was SVN r6861.
2005-08-13 20:19:24 +00:00
Brian Barrett
c83cb66bf2
* Portals can send "in place"
...
This commit was SVN r6860.
2005-08-13 19:43:08 +00:00
Galen Shipman
067357617f
add r2 to sources..
...
This commit was SVN r6853.
The following SVN revision numbers were found above:
r2 --> open-mpi/ompi@58fdc18855
2005-08-13 05:32:01 +00:00
Galen Shipman
c3fcf25508
fix to add_procs
...
This commit was SVN r6846.
2005-08-12 21:42:55 +00:00
Jeff Squyres
cf16a521c8
Ensure to get ompi/include/constants.h
...
This commit was SVN r6845.
2005-08-12 21:42:07 +00:00
Tim Woodall
0ab588e5d2
added support for sending eager messages directly from user buffer
...
if supported by btl - btl must set MCA_BTL_FLAGS_SEND_INPLACE
This commit was SVN r6844.
2005-08-12 21:33:01 +00:00
Tim Woodall
15c5fd6092
cleanup
...
This commit was SVN r6838.
2005-08-12 19:29:05 +00:00
Tim Woodall
faf146ec4c
correct address count
...
This commit was SVN r6837.
2005-08-12 19:01:04 +00:00
Galen Shipman
58f7c3abfb
Makefile typo...
...
This commit was SVN r6834.
2005-08-12 17:01:30 +00:00
Galen Shipman
df78b8957c
Misc fixes.. no need for procs hashtable in bml_r2..
...
This commit was SVN r6833.
2005-08-12 16:59:15 +00:00
Tim Woodall
5558c014b9
default TCP to only be used if self/sm/gm/mvapi.... are not available
...
This commit was SVN r6832.
2005-08-12 16:56:46 +00:00
Brian Barrett
a63f6e6ce6
re-add values for max tag and max cid to TEG and UNIQ.
...
This commit was SVN r6830.
2005-08-12 16:28:16 +00:00
Galen Shipman
9cbcdae14b
more BML related stuff.. static_components.h is autogen'd configure.params is
...
not. Compile warning fixed in pml_ob1_sendreq.c
This commit was SVN r6821.
2005-08-12 14:40:06 +00:00
Brian Barrett
2c44b2398d
* remove the src/ directory for Portals BTL to bring it in line with the
...
other BTLs
This commit was SVN r6820.
2005-08-12 14:33:45 +00:00
Galen Shipman
b01ebf45c9
Fixed build error related to direct call (bml_direct_call.h). Misc bug fixes
...
and compiler warning issues. Fixed threaded build issue.
This commit was SVN r6819.
2005-08-12 14:08:40 +00:00
Galen Shipman
c3c83aa3e1
BML (BTL Managment Layer). Allows BTL's to be used outside of the PML. See
...
bml.h and PML-OB1 for usage.
This commit was SVN r6815.
2005-08-12 02:41:14 +00:00
Tim Woodall
e083c706dc
removed debug output
...
This commit was SVN r6812.
2005-08-11 19:25:45 +00:00