Jeff Squyres
ba5615a18f
Merge in /tmp-public/cpc3 branch to trunk. oob/xoob still remains the
...
default CPC.
This commit was SVN r18356.
2008-05-02 11:52:33 +00:00
Jeff Squyres
72af302360
Remove unused variable.
...
This commit was SVN r18151.
2008-04-15 14:58:32 +00:00
Gleb Natapov
713a27dc71
Counter of created RDMA channels should be incremented immediately after channel
...
creation (not in control message completion) otherwise more than max_eager_rdma
channel may be created.
This commit was SVN r18082.
2008-04-06 13:48:45 +00:00
Jeff Squyres
5320c91ab3
Oops -- fix the constructor to also use opal_object_t instead of
...
opal_list_item_t.
This commit was SVN r17945.
2008-03-25 11:59:50 +00:00
Ralph Castain
d70e2e8c2b
Merge the ORTE devel branch into the main trunk. Details of what this means will be circulated separately.
...
Remains to be tested to ensure everything came over cleanly, so please continue to withhold commits a little longer
This commit was SVN r17632.
2008-02-28 01:57:57 +00:00
Pavel Shamis
a0d12a9c92
Adding support for APM over different ports
...
This commit was SVN r17521.
2008-02-20 13:44:05 +00:00
Pavel Shamis
3ba3f70624
Adding apm support for xrc.
...
This commit was SVN r17382.
2008-02-06 10:19:51 +00:00
Pavel Shamis
f0c478e7e0
XRC - replacing the new old API with new one.
...
This commit was SVN r17369.
2008-02-04 14:03:38 +00:00
Gleb Natapov
bb03e07ec4
Move eager RDMA channels accounting into completion callback. Otherwise it
...
can go wrong with XRC as endpoint may be not yet connected at the time
eager rdma channel is created.
This commit was SVN r17302.
2008-01-29 14:35:33 +00:00
Pavel Shamis
92ef832472
Making sure that XRC will not overrun ib_dev_attr.max_qp_wr
...
This commit was SVN r17300.
2008-01-29 13:15:21 +00:00
Pavel Shamis
7d83f34eb0
Protecting the apm code with OMPI_HAVE_THREADS.
...
This commit was SVN r17284.
2008-01-28 16:10:18 +00:00
Pavel Shamis
28a3917306
Adding APM support (over different lids).
...
This commit was SVN r17280.
2008-01-28 10:38:08 +00:00
Gleb Natapov
c9a1b06771
Remove trailing whitespaces. No code changes in this commit.
...
This commit was SVN r17167.
2008-01-21 12:11:18 +00:00
Gleb Natapov
51d6ca0cb6
Provide no lock version of mca_btl_openib_endpoint_post_rr(). On connection
...
creation we call it with endpoint lock already held.
This commit was SVN r17084.
2008-01-09 10:39:35 +00:00
Gleb Natapov
621fa223c5
Create free lists of fragments per HCA, not per BTL. Saves memory in case of
...
multiple LMCs.
This commit was SVN r17082.
2008-01-09 10:26:21 +00:00
Gleb Natapov
c3bbf69356
Set send_flags correctly in btl_openib_put. Otherwise we may reuse flags from
...
previous use of the buffer and they may be incorrect.
This commit was SVN r17058.
2008-01-07 10:19:07 +00:00
Gleb Natapov
b06d92bdab
OpenIB BTL has three channels through which data can be received (eager rdma,
...
high prio QPs and low prio QPs) and because not all of them are polled each time
progrgess() is called (to save on latency) starvation is possible. The commit
fixes this. Now each channel is polled, but higher priority channels are polled
more often. Three new parameters are introduced that control polling ratios
between different channels.
This commit was SVN r17024.
2007-12-23 12:29:34 +00:00
George Bosilca
906e8bf1d1
Replace the ompi_pointer_array with opal_pointer_array. The next step
...
(sometimes after the merge with the ORTE branch), the opal_pointer_array
will became the only pointer_array implementation (the orte_pointer_array
will be removed).
This commit was SVN r17007.
2007-12-21 06:02:00 +00:00
Gleb Natapov
f79e344ea4
Fix bug in debug build.
...
This commit was SVN r16972.
2007-12-17 10:26:18 +00:00
Gleb Natapov
17611dafbe
Fix pointer casting on 32bit machines.
...
This commit was SVN r16907.
2007-12-09 14:15:35 +00:00
Gleb Natapov
2f9c5b46cf
Return OMPI_ERR_RESOURCE_BUSY from openib_btl_send() if fragment is not on wire.
...
This commit was SVN r16906.
2007-12-09 14:14:11 +00:00
Gleb Natapov
5313a2baa7
Message coalescing for openib BTL. If fragment is waiting to be transmitted in
...
a pending queue pack another message into it if there is enough space there.
This commit was SVN r16900.
2007-12-09 14:05:13 +00:00
Gleb Natapov
de3761208a
Send cm_seen by eager rdma channel. Encode qp index into credits filed. If
...
cm_seen is not send here non symmetric eager rdma connection may hang.
This commit was SVN r16896.
2007-12-09 13:56:13 +00:00
Gleb Natapov
14cffee726
Uninline mca_btl_openib_post_srr() function.
...
This commit was SVN r16797.
2007-11-28 14:52:31 +00:00
Gleb Natapov
601952a952
Don't shared endpoint->qps array, only pointer to actual QP. Calculate send
...
queue size for shared QP based on all endpoints that want to use it.
This commit was SVN r16790.
2007-11-28 07:21:07 +00:00
Gleb Natapov
b46c9cc7bc
Make xrc use srq_qp unions instead of the xrc_qp which is exactly like srq_qp.
...
This commit was SVN r16789.
2007-11-28 07:20:26 +00:00
Gleb Natapov
be0981fc07
Change a type of xrc_recv_qp to "struct ibv_qp".
...
This commit was SVN r16788.
2007-11-28 07:19:36 +00:00
Gleb Natapov
bd47da4699
Initial XRC support by Mellanox.
...
This commit was SVN r16787.
2007-11-28 07:18:59 +00:00
Gleb Natapov
923666b75c
Process pending put/get frags on endpoint connection establishment.
...
This commit was SVN r16785.
2007-11-28 07:16:52 +00:00
Gleb Natapov
e502402470
Fix endpoint destructor to not skip closed endpoints.
...
This commit was SVN r16784.
2007-11-28 07:15:54 +00:00
Gleb Natapov
5a4e953aaa
Allow share the same qp for different buffer sizes. Needed for XRC support.
...
This commit was SVN r16783.
2007-11-28 07:15:20 +00:00
Gleb Natapov
5463eb892c
Send all explicit credits for PP QPs of all orders over smallest PP qp.
...
This commit was SVN r16781.
2007-11-28 07:13:34 +00:00
Gleb Natapov
a9f864d15c
If there is an eager rdma credit, but there is no WQE to send a packet we add it
...
to a pending queue of eager rdma QP instead of correct pending list. This patch
fixes this by getting reed of "eager rdma qp" notion. Packet is always send
over its order QP. The patch also adds two pending queues for high and low prio
packets. Only high prio packets are sent over eager RDMA channel.
This commit was SVN r16780.
2007-11-28 07:12:44 +00:00
Gleb Natapov
6a2d210b7d
Use OMPI object system to make fragment hierarchy more object oriented. The
...
main idea (except of cleanup) is to save on initialisation of unneeded fields
and to use C type checking system to catch obvious errors.
This commit was SVN r16779.
2007-11-28 07:11:14 +00:00
Gleb Natapov
60af46d541
We have QP description in component structure, module structure and endpoint.
...
Each one of them has a field to store QP type, but this is redundant.
Store qp type only in one structure (the component one).
This commit was SVN r16272.
2007-09-30 16:14:17 +00:00
Gleb Natapov
3a15d645be
Remove lcl_qp_attr from endpoint qp description. It is used during init only.
...
This commit was SVN r16270.
2007-09-30 15:29:35 +00:00
Gleb Natapov
c7105eadc7
Update Voltaire copyright.
...
This commit was SVN r16189.
2007-09-24 10:11:52 +00:00
Gleb Natapov
33196d972b
post_send() function is called without endpoint lock held from explicit credits
...
update function so eager_rdma_remote.head have to be updated in a thread safe
manner.
This commit was SVN r15966.
2007-08-27 11:37:01 +00:00
Gleb Natapov
32a61c3bf2
Credit fragment is not protected properly from concurrent access. There is a
...
race that can prevent further explicit credits update from been sent. Fix the
race.
This commit was SVN r15965.
2007-08-27 11:34:59 +00:00
Gleb Natapov
d8f3063895
Create only one CQ for all BTLs on the same HCA. Many BTLs can be created for
...
one HCA. Multiple ports, LMC, multiple BTLs per one LID. Having only one CQ for
all of them substantially reduce polling time.
This commit was SVN r15933.
2007-08-20 12:28:25 +00:00
Jeff Squyres
50bae9c603
Bring in the modular-wireup stuff for the openib BTL (from
...
/tmp/jms-modular-wireup branch):
* This commit moves all the openib BTL connection code out of
btl_openib_endpoint.c and into a connect "pseudo-component" area,
meaning that different schemes for doing OFA connection schemes can
be chosen via function pointer (i.e., MCA parameter) at run-time.
* The connect/connect.h file includes comments describing the
specific interface for the connect pseudo-component.
* Two pseudo-components are in this commit (more can certainly be
added).
* oob: use the same old oob/rml scheme for creating OFA connections
that we've had forever; this now just puts the logic into this
self-contained pseudo-component.
* rdma_cm: a currently-empty set of functions (that currently
return NOT_IMPLEMENTED) that will someday use the RDMA connection
manager to make OFA connections.
This commit was SVN r15786.
2007-08-06 23:40:35 +00:00
Gleb Natapov
758f932aa6
Handle credit in a thread safe manner. I am sure more work will have to be done
...
in this are.
This commit was SVN r15721.
2007-08-01 12:15:43 +00:00
Gleb Natapov
9c20d67301
1) Return IB header to it's previous size by using char for cm_seen field.
...
2) Allow to specify rd_win/rd_rsv parameters by user, but make them optional.
This commit was SVN r15719.
2007-08-01 12:10:56 +00:00
Gleb Natapov
2d9669a69d
mca_btl_openib_endpoint_post_send() is called with endpoint lock held.
...
No need to call lock() in btl_openib_acquire_send_resources().
This commit was SVN r15678.
2007-07-30 09:03:08 +00:00
Jeff Squyres
015fc08ff4
Remove the ib_static_rate MCA parameter; it will be replaced with a
...
dynamic mechanism to adjust the rate only if necessary (e.g., two
ports of differing speeds are connected).
This commit was SVN r15653.
2007-07-26 21:10:51 +00:00
Galen Shipman
514811c50b
cleanup btl.h comments
...
document the btl interface a bit better
This commit was SVN r15618.
2007-07-25 17:26:23 +00:00
Galen Shipman
325c184fb4
remove debugging "abort()"
...
fix a debugging assert
This commit was SVN r15611.
2007-07-25 14:51:19 +00:00
Gleb Natapov
5b7d3faedc
Implement "credit management for credit messages" protocol. On each message a
...
sender piggybacks a number of credit messages it received from a peer. A number
of outstanding credit messages is limited. This is needed to never ever fall
back to HW flow control.
This commit was SVN r15580.
2007-07-24 15:19:51 +00:00
Gleb Natapov
45fcb45e31
Remove debug checks that produce lots of warnings during compilation.
...
This commit was SVN r15479.
2007-07-18 13:49:15 +00:00
Gleb Natapov
30b2183314
Remove debug output from a hot path.
...
This commit was SVN r15478.
2007-07-18 12:48:34 +00:00