Jon Mason
626e0814a2
Style clean-up
...
This commit was SVN r17126.
2008-01-12 18:47:17 +00:00
Jon Mason
3970c3ff6c
Add Chelsio T3 to ompi/mca/btl/openib/mca-btl-openib-hca-params.ini
...
This commit was SVN r17101.
2008-01-09 22:14:18 +00:00
Jon Mason
597c7e68f1
Minor cleanups
...
This commit was SVN r17100.
2008-01-09 21:54:11 +00:00
Gleb Natapov
25ce70bb92
Call mca_btl_openib_endpoint_post_send() holding endpoint lock and not holding
...
qp lock since this is what the function assumes.
This commit was SVN r17086.
2008-01-09 14:46:41 +00:00
Pavel Shamis
99f51482e3
Fixing openib finalization flow.
...
This commit was SVN r17085.
2008-01-09 12:36:30 +00:00
Gleb Natapov
51d6ca0cb6
Provide no lock version of mca_btl_openib_endpoint_post_rr(). On connection
...
creation we call it with endpoint lock already held.
This commit was SVN r17084.
2008-01-09 10:39:35 +00:00
Gleb Natapov
50af6b9e78
Rearrange functions order so that functions are defined before they are used. No
...
code changes here.
This commit was SVN r17083.
2008-01-09 10:27:15 +00:00
Gleb Natapov
621fa223c5
Create free lists of fragments per HCA, not per BTL. Saves memory in case of
...
multiple LMCs.
This commit was SVN r17082.
2008-01-09 10:26:21 +00:00
Gleb Natapov
5ce3213158
Rearrange functions order so that functions are defined before they are used. No
...
code changes here.
This commit was SVN r17081.
2008-01-09 10:05:41 +00:00
Pavel Shamis
fbf7bcd9a9
We need to prepost on srq/xrc before reply with ENDPOINT_XOOB_CONNECT_XRC_RESPONSE.
...
This commit was SVN r17066.
2008-01-08 10:30:16 +00:00
Gleb Natapov
c3bbf69356
Set send_flags correctly in btl_openib_put. Otherwise we may reuse flags from
...
previous use of the buffer and they may be incorrect.
This commit was SVN r17058.
2008-01-07 10:19:07 +00:00
Jeff Squyres
a234ba198a
Remove superflous / unused -D from Makefile.am.
...
This commit was SVN r17030.
2008-01-02 18:00:20 +00:00
Gleb Natapov
2fb6947f88
Destroy endpoints that use eager rdma communication before destroying SRQ. Do't
...
skip async event thread destruction if SRQ was not destroyed, or it will segfault
on module removal.
This commit was SVN r17025.
2007-12-23 13:58:31 +00:00
Gleb Natapov
b06d92bdab
OpenIB BTL has three channels through which data can be received (eager rdma,
...
high prio QPs and low prio QPs) and because not all of them are polled each time
progrgess() is called (to save on latency) starvation is possible. The commit
fixes this. Now each channel is polled, but higher priority channels are polled
more often. Three new parameters are introduced that control polling ratios
between different channels.
This commit was SVN r17024.
2007-12-23 12:29:34 +00:00
Jeff Squyres
558d179e2e
Fix typo.
...
This commit was SVN r17012.
2007-12-21 14:25:48 +00:00
George Bosilca
906e8bf1d1
Replace the ompi_pointer_array with opal_pointer_array. The next step
...
(sometimes after the merge with the ORTE branch), the opal_pointer_array
will became the only pointer_array implementation (the orte_pointer_array
will be removed).
This commit was SVN r17007.
2007-12-21 06:02:00 +00:00
Pavel Shamis
fcbca510d8
The ib_inline_max should be updated only when SEND qp is created.
...
This commit was SVN r16973.
2007-12-17 10:30:30 +00:00
Gleb Natapov
f79e344ea4
Fix bug in debug build.
...
This commit was SVN r16972.
2007-12-17 10:26:18 +00:00
Gleb Natapov
64a95f63cd
Fix error reporting in openib if parameter value is out of range.
...
This commit was SVN r16971.
2007-12-16 14:04:36 +00:00
Gleb Natapov
8b511b969d
Introduce a new BTL parameter btl_rndv_eager_limit which determines size of a
...
first fragment of rendezvous protocol. Remove no longer used btl_min_send_size
parameter.
This commit was SVN r16969.
2007-12-16 08:35:17 +00:00
Jeff Squyres
213b5d5c6e
Per long threads on the mailing list and much confusion discussion
...
about linkers, have all OPAL, ORTE, and OMPI components '''not'' link
against the OPAL, ORTE, or OMPI libraries.
See ttp://www.open-mpi.org/community/lists/users/2007/10/4220.php for
details (or https://svn.open-mpi.org/trac/ompi/wiki/Linkers for a
better-formatted version of the same info).
This commit was SVN r16968.
2007-12-15 13:32:02 +00:00
Jon Mason
e05cd7b0e4
To modify the default connection method, a "btl_openib_connect <arg>"
...
should be passed via commandline. However, there is a slight coding
bug in the openib connect code. When registering the name of the
option, mca_base_param_reg_string will prepend the relevant info
("btl_openib_" in this case). The existing code will require
"btl_openib_btl_openib_connect" instead of "btl_openib_connect".
This patch corrects this.
This commit was SVN r16937.
2007-12-11 20:36:36 +00:00
Gleb Natapov
2a59b2a68f
1. Set segments length in prepare_src() after packing because actual size may be
...
smaller then allocated size.
2. If reserve zero don't allocate coalesced frag since it will be RDMAed, not
send. The logic was other way around.
This commit was SVN r16928.
2007-12-11 13:10:52 +00:00
Jon Mason
df82fcb917
Slight word usage and grammar error in the openib btl help test. I
...
believe the change below is the intended meaning.
This commit was SVN r16921.
2007-12-10 21:50:48 +00:00
Gleb Natapov
17611dafbe
Fix pointer casting on 32bit machines.
...
This commit was SVN r16907.
2007-12-09 14:15:35 +00:00
Gleb Natapov
2f9c5b46cf
Return OMPI_ERR_RESOURCE_BUSY from openib_btl_send() if fragment is not on wire.
...
This commit was SVN r16906.
2007-12-09 14:14:11 +00:00
Gleb Natapov
493951e09d
Add heterogeneous support to message coalescing.
...
This commit was SVN r16903.
2007-12-09 14:10:25 +00:00
Gleb Natapov
b4698dc6df
Use flags provided during allocation to coalesce to correct priority queue.
...
This commit was SVN r16902.
2007-12-09 14:08:55 +00:00
Gleb Natapov
e2e211f23b
Add flags parameter to btl_alloc() and btl_prepare_src() functions. If BTL
...
knows at the time of allocation priority of a descriptor it may do some
optimizations.
This commit was SVN r16901.
2007-12-09 14:08:01 +00:00
Gleb Natapov
5313a2baa7
Message coalescing for openib BTL. If fragment is waiting to be transmitted in
...
a pending queue pack another message into it if there is enough space there.
This commit was SVN r16900.
2007-12-09 14:05:13 +00:00
Gleb Natapov
7302cd24eb
Call btl_alloc() from btl_prepare_src() to have one point of frag allocation.
...
This commit was SVN r16899.
2007-12-09 14:02:32 +00:00
Gleb Natapov
7364b7cf47
Add endpoint parameter to btl_alloc() function. Enables various optimizations
...
inside BTL.
This commit was SVN r16898.
2007-12-09 14:00:42 +00:00
Gleb Natapov
de3761208a
Send cm_seen by eager rdma channel. Encode qp index into credits filed. If
...
cm_seen is not send here non symmetric eager rdma connection may hang.
This commit was SVN r16896.
2007-12-09 13:56:13 +00:00
Jon Mason
20294e7800
There is a double call to ompi_btl_openib_connect_base_open in
...
mca_btl_openib_mca_setup_qps(). It looks like someone just forgot to
clean-up the previous call when they added the check for the return
code.
I ran a quick IMB test over IB to verify everything is still working.
This commit was SVN r16870.
2007-12-06 17:25:38 +00:00
Pavel Shamis
e8aeadb11e
XRC fixes:
...
- create separate xrc domain file for each hca
- return error if we failed to create xrc file.
This commit was SVN r16853.
2007-12-05 14:32:44 +00:00
Pavel Shamis
f60ca0e4e5
Removing unused mca_btl_openib_ib_address_status
...
This commit was SVN r16835.
2007-12-04 13:16:26 +00:00
Pavel Shamis
57728986f8
Fixing XRC multiport/multisubnet support.
...
This commit was SVN r16819.
2007-12-03 09:49:53 +00:00
Gleb Natapov
b2858236fb
Use new free list interface.
...
This commit was SVN r16818.
2007-12-02 15:13:11 +00:00
Gleb Natapov
a774cd98f8
Put send completions to low prio CQ. Receive is more important.
...
This commit was SVN r16817.
2007-12-02 14:46:37 +00:00
Gleb Natapov
b17f5b7480
Change how default receive queues parameters are calculated. Current default
...
parameters don't make any sense. Credits are never piggybacked. Also make
default queue sizes to be calculated from eager_limit and max_send_size values.
This commit was SVN r16816.
2007-12-02 14:43:28 +00:00
Jeff Squyres
8c0060701c
Stub out the ibcm CPC.
...
This commit was SVN r16800.
2007-11-29 13:23:17 +00:00
Pavel Shamis
8aca6eb31b
OFED 1.3 doesn't implement ibv_resize_cq for connectX.
...
On error exit from ibv_resize_cq we should to check if the function
is implemented.
This commit was SVN r16799.
2007-11-28 15:23:19 +00:00
Gleb Natapov
5f242c77f2
Post each recv wr not separately but in one call to ibv_post_recv().
...
This commit was SVN r16798.
2007-11-28 14:57:15 +00:00
Gleb Natapov
14cffee726
Uninline mca_btl_openib_post_srr() function.
...
This commit was SVN r16797.
2007-11-28 14:52:31 +00:00
Pavel Shamis
1c314ef4c3
If XRC qp was specified in btl_openib_receive_queues we automatically should
...
choose xoob connection module.
This commit was SVN r16796.
2007-11-28 10:33:32 +00:00
Pavel Shamis
488a508732
Removing comments from help file.
...
This commit was SVN r16795.
2007-11-28 10:16:08 +00:00
Pavel Shamis
3e2e4f6d2a
Removing unused lid.
...
This commit was SVN r16794.
2007-11-28 10:06:57 +00:00
Pavel Shamis
aa79bdabc8
Removing port_touse - we don't really need it
...
This commit was SVN r16793.
2007-11-28 09:57:48 +00:00
Pavel Shamis
2ffbe8776a
Fixing compilation problems in openib
...
This commit was SVN r16792.
2007-11-28 09:38:49 +00:00
Gleb Natapov
218adb2a96
Account for eager rdma credit fragments when creating send queue. Create XRC
...
receive QP with zero receive and send queue length. We don't going to use this
QP for send and receives a posted to SRQs.
This commit was SVN r16791.
2007-11-28 07:22:01 +00:00