From 2490359066bdb9b1a1d21db7c9848f26eb2e6137 Mon Sep 17 00:00:00 2001 From: Arun C Ilango Date: Wed, 6 Apr 2016 09:19:24 -0700 Subject: [PATCH] verbs/RDM: Update Readme, news and man pages. Signed-off-by: Arun C Ilango --- NEWS.md | 6 ++++++ README.md | 20 ++++++++++++++++++++ man/fi_verbs.7.md | 10 +++++++++- 3 files changed, 35 insertions(+), 1 deletion(-) diff --git a/NEWS.md b/NEWS.md index c8aad62cb4a..0ddbea6fdf5 100644 --- a/NEWS.md +++ b/NEWS.md @@ -113,6 +113,12 @@ alternatives to validating your installation. - Support the case where the user creates only a send or recv queue for the endpoint. - Fix an issue where RMA reads were not working on iWARP cards. +- verbs/RDM + - Add support for RMA operations. + - Add support for fi_cq_sread and fi_cq_sreadfrom + - Rework connection management to make it work with fabtests and also allow + connection to self. + - Other bug fixes and performance improvements. v1.2.0, Thu Jan 7, 2016 ======================= diff --git a/README.md b/README.md index 81fca3d5cbe..019302e3987 100644 --- a/README.md +++ b/README.md @@ -227,3 +227,23 @@ provider will not be built. If `` is specified, then check in the directory and check for `libnl` version 3. If version 3 is not found, then check for version 1. If no `` argument is specified, then this option is redundant with `--with-usnic`. + +### verbs + +*** + +The verbs provider enables applications using OFI to be run over any verbs +hardware (Infiniband, iWarp, etc). It uses the Linux Verbs API for network +transport and provides a translation of OFI calls to appropriate verbs API calls. +It uses librdmacm for communication management and libibverbs for other control +and data transfer operations. + +See the `fi_verbs(7)` man page for more details. + +#### Dependencies + +- The verbs provider requires libibverbs (v1.1.8 or newer) and librdmacm (v1.0.16 + or newer). If you are compiling Libfabric from source and want to enable verbs + support, you will also need the matching header files for the above two libraries. + If the libraries and header files are not in default paths, specify them in CFLAGS, + LDFLAGS and LD_LIBRARY_PATH environment variables. diff --git a/man/fi_verbs.7.md b/man/fi_verbs.7.md index 60f193ea032..e204c61bc90 100644 --- a/man/fi_verbs.7.md +++ b/man/fi_verbs.7.md @@ -22,7 +22,7 @@ and data transfer operations. The verbs provider supports a subset of OFI features. *Endpoint types* -: FI_EP_MSG, FI_EP_RDM (Experimental support for only FI_TAGGED interface). +: FI_EP_MSG, FI_EP_RDM (Experimental support FI_TAGGED and FI_RMA interfaces). *Endpoint capabilities* : FI_MSG, FI_RMA, FI_ATOMIC. @@ -72,6 +72,14 @@ The verbs provider supports a subset of OFI features. : Application has to make sure CQs are not overrun as this cannot be detected by the provider. +*RDM* +: The RDM support for verbs have the following limitations: + * iWARP is not supported yet. + * Supports iovs of only size 1. + * Max data transfer size is 1 GB + * Not thread safe. + * Data and flags arguments are ignored + # SEE ALSO [`fabric`(7)](fabric.7.html),