verbs_usnic: do not build by default

This component is a workaround to a bug in libibverbs that prints a
dire warning that usNIC devices are not supported (of course not --
usNIC devices provide functionality through libfabric, not
libibverbs).  This component was written before a better workaround
was created: a "no op" libibverbs plugin for usNIC devices
(https://github.com/cisco/libusnic_verbs, and is also available in
binary form on cisco.com).

Hence, this component no longer builds by default.  It's still
available if a user specifically asks for it (e.g., if they do not
want to install the "no op" libibverbs plugin), but it's not the
default.  This component also has the side-effect of making
libopen-pal.so depend on libibverbs.so, which can be annoying for
packagers (which is another reason it isn't built by default any
more).

README

@@ -8,7 +8,7 @@ Copyright (c) 2004-2008 High Performance Computing Center Stuttgart,
                         University of Stuttgart.  All rights reserved.
 Copyright (c) 2004-2007 The Regents of the University of California.
                         All rights reserved.
-Copyright (c) 2006-2015 Cisco Systems, Inc.  All rights reserved.
+Copyright (c) 2006-2016 Cisco Systems, Inc.  All rights reserved.
 Copyright (c) 2006-2011 Mellanox Technologies. All rights reserved.
 Copyright (c) 2006-2012 Oracle and/or its affiliates.  All rights reserved.
 Copyright (c) 2007      Myricom, Inc.  All rights reserved.
@@ -952,6 +952,17 @@ NETWORKING SUPPORT / OPTIONS
   which covers most cases.  This option is only needed for special
   configurations.
 
+--with-verbs-usnic
+  This option will activate support in Open MPI for disabling a
+  dire-sounding warning message from libibverbs that Cisco usNIC
+  devices are not supported (because Cisco usNIC devices are supported
+  through libfabric, not libibverbs).  This libibverbs warning can
+  also be suppressed by installing the "no op" libusnic_verbs plugin
+  for libibverbs (see https://github.com/cisco/libusnic_verbs, or
+  download binaries from cisco.com).  This option is disabled by
+  default because it causes libopen-pal.so to depend on libibverbs.so,
+  which is undesirable to many downstream packagers.
+
 --with-usnic
   Abort configure if Cisco usNIC support cannot be built.
 

opal/mca/common/verbs_usnic/configure.m4

@@ -10,7 +10,7 @@
 #                         University of Stuttgart.  All rights reserved.
 # Copyright (c) 2004-2005 The Regents of the University of California.
 #                         All rights reserved.
-# Copyright (c) 2007-2015 Cisco Systems, Inc.  All rights reserved.
+# Copyright (c) 2007-2016 Cisco Systems, Inc.  All rights reserved.
 # Copyright (c) 2009-2012 Mellanox Technologies.  All rights reserved.
 # Copyright (c) 2009-2012 Oak Ridge National Laboratory.  All rights reserved.
 # $COPYRIGHT$
@@ -20,6 +20,22 @@
 # $HEADER$
 #
 
+#
+# This component is a workaround to a bug in libibverbs that prints a
+# dire warning that usNIC devices are not supported (of course not --
+# usNIC devices provide functionality through libfabric, not
+# libibverbs).  This component was written before a better workaround
+# was created: a "no op" libibverbs plugin for usNIC devices
+# (https://github.com/cisco/libusnic_verbs, and is also available in
+# binary form on cisco.com).
+#
+# Hence, this component no longer builds by default.  It's still
+# available if a user specifically asks for it (e.g., if they do not
+# want to install the "no op" libibverbs plugin), but it's not the
+# default.  This component also has the side-effect of making
+# libopen-pal.so depend on libibverbs.so, which can be annoying for
+# packagers (which is another reason it isn't built by default any
+# more).
 #
 # This component must be linked statically into libopen-pal because it
 # registers a provider for libibverbs at run time, and there's no
@@ -40,8 +56,17 @@ AC_DEFUN([MCA_opal_common_verbs_usnic_CONFIG],[
     AC_CONFIG_FILES([opal/mca/common/verbs_usnic/Makefile])
     common_verbs_usnic_happy="no"
 
-    OPAL_CHECK_OPENFABRICS([common_verbs_usnic],
-                           [common_verbs_usnic_happy="yes"])
+    AC_ARG_WITH(verbs-usnic,
+                AC_HELP_STRING([--with-verbs-usnic],
+                               [Add support in Open MPI to defeat a seemingly dire warning message from libibverbs that Cisco usNIC devices are not supported.  This support is not compiled by default because you can also avoid this libibverbs bug by installing the libibverbs_usnic "no no" plugin, available from https://github.com/cisco/libusnic_verbs or in binary form from cisco.com]))
+
+    AS_IF([test "$with_verbs_usnic" = "yes"],
+          [common_verbs_usnic_happy=yes])
+
+    AS_IF([test "$common_verbs_usnic_happy" = "yes"],
+          [OPAL_CHECK_OPENFABRICS([common_verbs_usnic],
+                                  [common_verbs_usnic_happy="yes"])
+          ])
 
     AS_IF([test "$common_verbs_usnic_happy" = "yes"],
           [$1],