Skip to content

Commit

Permalink
Merge pull request #12163 from hppritcha/docs_updates_for_ss11_v50x
Browse files Browse the repository at this point in the history
v5.0.x: docs: add some info about HPE CXI ofi provider
  • Loading branch information
wenduwan authored Dec 21, 2023
2 parents 9c128e8 + 212d8ae commit e0ff2ee
Showing 1 changed file with 10 additions and 2 deletions.
12 changes: 10 additions & 2 deletions docs/tuning-apps/networking/ofi.rst
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ including (but not limited to):
* Cisco usNIC
* Cray uGNI
* Cornelius Networks Omni-Path
* HPE Slingshot 11

In general, the OFI-based components in Open MPI will auto-select
themselves as appropriate at run time.
Expand All @@ -43,8 +44,9 @@ communications:
``FI_EP_RDM`` endpoints, ``FI_TAGGED`` capabilities, and
``FI_ORDER_SAS`` ordering).

#. ``ofi`` BTL: Available since Open MPI v4.0.0, this component is
used for one-sided MPI communications (e.g., ``MPI_PUT``). The
#. ``ofi`` BTL: Available since Open MPI v4.0.0, this component is primarily
intended for one-sided MPI communications (e.g., ``MPI_PUT``). It
can also support BTL send/recv operations.
``ofi`` BTL requires that the Libfabric provider support reliable
datagrams, RMA and atomic operations, and remote atomic completion
notifications (specifically: ``FI_EP_RDM`` endpoints, ``FI_RMA``
Expand Down Expand Up @@ -76,6 +78,12 @@ list. For example:
shell$ ompi_info --param mtl ofi --level 9
.. important:: When using the HPE CXI provider and ``mpirun`` as the job launcher,
it is recommended that the PRTE ``ras_base_launch_orted_on_hn`` MCA parameter be set to 1.
This can be done by adding ``--prtemca ras_base_launch_orted_on_hn 1`` to the job launch
command line. This ensures that MPI processes launched on the first node of
an allocation are able to use the CXI provider.

For more information refer to the `Libfabric web site
<https://libfabric.org/>`_.

Expand Down

0 comments on commit e0ff2ee

Please sign in to comment.