lib/mlx5: API to configure UMR

Add API to configure regular UMR, without BSF and
any offloads, only scatter-gather functionality

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: Ib4f

lib/mlx5: API to configure UMR

Add API to configure regular UMR, without BSF and
any offloads, only scatter-gather functionality

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: Ib4fb21c5d27c3a89aef649ca6fd0162ba9d10e8a
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/24706
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
Community-CI: Mellanox Build Bot
Community-CI: Community CI Samsung <spdk.community.ci.samsung@gmail.com>
Reviewed-by: Ben Walker <ben@nvidia.com>
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>

show more ...

lib/mlx5: Add API to check if UMR registration supported

The 2 new APIs are used for negotiation between different
modules to use accel sequence/UMR

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.

lib/mlx5: Add API to check if UMR registration supported

The 2 new APIs are used for negotiation between different
modules to use accel sequence/UMR

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: Ifca6a3e3a7649e48392785d7a977e1b468dbf4be
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/24700
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com>
Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com>
Community-CI: Community CI Samsung <spdk.community.ci.samsung@gmail.com>
Community-CI: Mellanox Build Bot

show more ...

lib/mlx5: Remove legacy DEK creation

That is no longer needed since we use PRM implementation

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: Idb9079ac023f2ed3c10a8405d62ee33bc76087

lib/mlx5: Remove legacy DEK creation

That is no longer needed since we use PRM implementation

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: Idb9079ac023f2ed3c10a8405d62ee33bc760873e
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/24498
Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com>
Reviewed-by: Ben Walker <ben@nvidia.com>
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
Community-CI: Mellanox Build Bot
Reviewed-by: Jim Harris <jim.harris@samsung.com>

show more ...

lib/mlx5: Add signature support

- API to create PSV - Persistent Signature Value
which is used to store signature and other metadata.
- API to reset PSV after signature error.
- API to configure UMR

lib/mlx5: Add signature support

- API to create PSV - Persistent Signature Value
which is used to store signature and other metadata.
- API to reset PSV after signature error.
- API to configure UMR with CRC32C capabilities
- mkey pool can be created with signature capabilities
- spdk_mlx5_device_query_caps reports crc32c support

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Signed-off-by: Sergey Gorenko <sergeygo@nvidia.com>
Change-Id: I6a0fa9a6a1de332381b35f0f7a07350b8814149d
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/23136
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
Reviewed-by: Ben Walker <ben@nvidia.com>
Community-CI: Mellanox Build Bot
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>

show more ...

env: add SPDK_ENV_NUMA_ID_ANY and replace socket_id with numa_id

We will try to avoid further proliferation of "SOCKET_ID" to refer
to a NUMA socket ID moving forward, and just use "NUMA_ID" to avoi

env: add SPDK_ENV_NUMA_ID_ANY and replace socket_id with numa_id

We will try to avoid further proliferation of "SOCKET_ID" to refer
to a NUMA socket ID moving forward, and just use "NUMA_ID" to avoid
confusion with TCP sockets.

Change all of the existing in-tree SPDK_ENV_SOCKET_ID_ANY uses to
SPDK_ENV_NUMA_ID_ANY, but keep the old #define around, at least for
now. Also change all 'socket_id' parameters to 'numa_id'.

We still have spdk_env_get_socket_id(), we will need to keep this
but next patch will add spdk_env_get_numa_id().

Signed-off-by: Jim Harris <jim.harris@samsung.com>
Change-Id: Idc31c29e32b708c24d88f9c6fecaf9a99e34ba1e
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/24607
Reviewed-by: Aleksey Marchuk <alexeymar@nvidia.com>
Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com>
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
Reviewed-by: Ben Walker <ben@nvidia.com>
Community-CI: Mellanox Build Bot

show more ...

lib/mlx5: Remove spdk_mlx5_crypto_set_attr

THe only user was accel_mlx5, this function
is not used anymore

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: I10b947c175f61cd583c6cd814

lib/mlx5: Remove spdk_mlx5_crypto_set_attr

THe only user was accel_mlx5, this function
is not used anymore

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: I10b947c175f61cd583c6cd814afb48f7b1cf4b8b
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/23119
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
Reviewed-by: Ben Walker <ben@nvidia.com>
Community-CI: Mellanox Build Bot

show more ...

accel/mlx5: Use internal PRM based mlx5 library

That gives much higher performance
Other changes
- Add API to get verbs qp from mlx5 qp - needed
for memory domain translation
- Account number of exp

accel/mlx5: Use internal PRM based mlx5 library

That gives much higher performance
Other changes
- Add API to get verbs qp from mlx5 qp - needed
for memory domain translation
- Account number of expected CQ entries to skip busy
polling of CQ
- Count number of operations submitted to QP to prevent
QP overflow
- Use mlx5 mkey_pool API

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: I42a2f3305e1d4fa876a674b5c9f572a5802e0847
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/23118
Reviewed-by: Ben Walker <ben@nvidia.com>
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
Community-CI: Mellanox Build Bot
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>

show more ...

lib/mlx5: Update keytag creation to use PRM

The new way to create DEKs is not compatible with
mlx5dv API used by accel_mlx5, so both methods of creating
DEKs remain in this patch. Legacy way will be

lib/mlx5: Update keytag creation to use PRM

The new way to create DEKs is not compatible with
mlx5dv API used by accel_mlx5, so both methods of creating
DEKs remain in this patch. Legacy way will be removed soon.

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: I7be82f6ec6cbacc56ab1482537a806792a7e2a77
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/23107
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
Community-CI: Mellanox Build Bot
Reviewed-by: Ben Walker <ben@nvidia.com>
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>

show more ...

lib/mlx5: API to query device capabilities

Only crypto caps are fetched for now, the API will
be extended later

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: I0fafe6e4de3a116ed682

lib/mlx5: API to query device capabilities

Only crypto caps are fetched for now, the API will
be extended later

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: I0fafe6e4de3a116ed68226feb28548af8645a722
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/23106
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
Reviewed-by: Ben Walker <ben@nvidia.com>
Community-CI: Mellanox Build Bot

show more ...

lib/mlx5: Add API to configure crypto UMR

Add API to configure UMR with crypto capabilities.
UMR configuration work on top of an mkey obtained from
the spdk_mlx5_mkey_pool. Crypto UMR requires the p

lib/mlx5: Add API to configure crypto UMR

Add API to configure UMR with crypto capabilities.
UMR configuration work on top of an mkey obtained from
the spdk_mlx5_mkey_pool. Crypto UMR requires the pool
to be created with crypto capabilities, that means that
device backed by PD supports crypto capabilities

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: Ic3c346a4b838804a52d43cb7e0d7e3ffa86bacf4
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/23105
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
Community-CI: Mellanox Build Bot
Reviewed-by: Ben Walker <ben@nvidia.com>
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>

show more ...

lib/mlx5: Add API to create/destroy and use mkey pools

Mkey pool is created per Protection Domain (PD). Each
PD may have several pools of different types (crypto or
no crypto right now).

Signed-off

lib/mlx5: Add API to create/destroy and use mkey pools

Mkey pool is created per Protection Domain (PD). Each
PD may have several pools of different types (crypto or
no crypto right now).

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: Iaed34144e67ada7ec6980587900f5dca628a9044
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/23104
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
Reviewed-by: Ben Walker <ben@nvidia.com>
Community-CI: Mellanox Build Bot

show more ...

lib/mlx5: Add RDMA_READ/WRITE and CQ polling API

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: I30d79b809539d90173228ed54eda0ed139a76d22
Reviewed-on: https://review.spdk.io/gerrit/

lib/mlx5: Add RDMA_READ/WRITE and CQ polling API

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: I30d79b809539d90173228ed54eda0ed139a76d22
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/23103
Community-CI: Mellanox Build Bot
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
Reviewed-by: Ben Walker <ben@nvidia.com>
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>

show more ...

lib/mlx5: Add native implementation of CQ and QP

Add functions to create, destory CQ and QP
Next patches add implementation of other API
used in IO path to replace mlx5_dv API. Under the
hood CQ and

lib/mlx5: Add native implementation of CQ and QP

Add functions to create, destory CQ and QP
Next patches add implementation of other API
used in IO path to replace mlx5_dv API. Under the
hood CQ and QP are created used verbs API and then
low level objects are extracted to be used directly.

mlx5_ifc.h is a binary interface to the HW according
to the PRM.
mlx5_ifc.h is a copy of rdma-core header version v51.0
with some modifications. Original copyright is kept.
This file is available under a choice of one of two
licenses: GPL v2 or BSD-2-Clause (the clause is not
specified explicitly but the text matches the 2-clause)
LICENSE file was updated with mentioning that mlx5_ifc.h
in SPDK tree is BSD-2-Clause

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: If5415729019c85eda8e6a1494164d3d0bab9ee94
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/23102
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
Reviewed-by: Ben Walker <ben@nvidia.com>
Community-CI: Mellanox Build Bot

show more ...

mlx5: Allow to filter devices by name

accel_mlx5 can be configured with a list
of comma separated device names to be used

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: I56f1ff951f

mlx5: Allow to filter devices by name

accel_mlx5 can be configured with a list
of comma separated device names to be used

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: I56f1ff951fa87f7b4e0ebb87679831c8bdc37021
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/23099
Reviewed-by: Ben Walker <ben@nvidia.com>
Community-CI: Mellanox Build Bot
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>

show more ...

lib/rdma_utils: Intorduce generic rdma utils lib

This library holds generic rdma functions from
rdma_provider. That is done to avoid cross link
reference in future patches. The library will be
exten

lib/rdma_utils: Intorduce generic rdma utils lib

This library holds generic rdma functions from
rdma_provider. That is done to avoid cross link
reference in future patches. The library will be
extended with new functionality

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: If1918efb0fe6f0baa77cf20f992fbd6a97de4264
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/23072
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
Reviewed-by: Ben Walker <ben@nvidia.com>
Community-CI: Mellanox Build Bot
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>

show more ...

lib/rdma: Rename lib to rdma_provider

The new name better reflects purpose of this library
Next patch moves part of functions to a dedicated lib
and the new name helps to avoid confusion

Signed-off

lib/rdma: Rename lib to rdma_provider

The new name better reflects purpose of this library
Next patch moves part of functions to a dedicated lib
and the new name helps to avoid confusion

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: If7296ed77a07f7084bce66971d6937d7671b3a91
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/23071
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
Community-CI: Mellanox Build Bot
Reviewed-by: Ben Walker <ben@nvidia.com>
Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>

show more ...

so_ver: increase all major versions after SPDK 24.01

To allow SO_MINOR updates on LTS for the whole year it is supported,
the major version for all components needs to be increased.
This is to preve

so_ver: increase all major versions after SPDK 24.01

To allow SO_MINOR updates on LTS for the whole year it is supported,
the major version for all components needs to be increased.
This is to prevent scenario where two versions exists with matching
versions, but conflicting ABI.
Ex. Next SPDK release adds an API call increasing the minor version,
then LTS needs just a subset of those additions.

Increasing major so version after LTS, allows the future releases
to update versions as needed. Yet allowing LTS to increase minor
version separately.

This patch:
- increases SO_VER by 1 for all components
- resets SO_MINOR to 0 for all components

Due to patch below being introduced after v24.01 code freeze,
bdev lib version should not be increased:
61623c5ca9 bdev: add spdk_bdev_io padding in place of io_submit_ch

Short reference to how the versions were changed:
MAX=$(git grep "SO_VER := " | cut -d" " -f 3 | sort -ubnr | head -1)
for((i=$MAX;i>0;i-=1)); do find . -name "Makefile" -exec \
sed -i -e "s/SO_VER := $i\$/SO_VER := $(($i+1))/g" {} +; done
find . -name "Makefile" -exec \
sed -i -e "s/SO_MINOR := .*/SO_MINOR := 0/g" {} +

Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
Change-Id: I0166d6be6c17bbbf985d48b5dfcb36f1d4af1b48
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/21582
Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com>
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>

show more ...

so_ver: increase all major versions

To allow SO_MINOR updates on LTS for the whole year it is supported,
the major version for all components needs to be increased.
This is to prevent scenario where

so_ver: increase all major versions

To allow SO_MINOR updates on LTS for the whole year it is supported,
the major version for all components needs to be increased.
This is to prevent scenario where two versions exists with matching
versions, but conflicting ABI.
Ex. Next SPDK release adds an API call increasing the minor version,
then LTS needs just a subset of those additions.

Increasing major so version after LTS, allows the future releases
to update versions as needed. Yet allowing LTS to increase minor
version separately.

Disabled test for increasing SO version without ABI change, as
that is goal of this patch. This check shall be removed with SPDK 23.05
release.
Looks like this was left over from prior LTS, to avoid that
make sure it is only skipped when running against v23.01.x as latest
release.

This patch:
- increases SO_VER by 1 for all components
- resets SO_MINOR to 0 for all components
- removes suppressions for ABI tests


Short reference to how the versions were changed:
MAX=$(git grep "SO_VER := " | cut -d" " -f 3 | sort -ubnr | head -1)
for((i=$MAX;i>0;i-=1)); do find . -name "Makefile" -exec \
sed -i -e "s/SO_VER := $i\$/SO_VER := $(($i+1))/g" {} +; done
find . -name "Makefile" -exec \
sed -i -e "s/SO_MINOR := .*/SO_MINOR := 0/g" {} +

Change-Id: I3e5681802c0a5ac6d7d652a18896997cd07cc8bf
Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/16419
Reviewed-by: Ben Walker <benjamin.walker@intel.com>
Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com>
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>

show more ...

module/accel: Add mlx5 accel module

The mlx5 accel module supports crypto operations.
Data buffer is split into `block_size` chunks and each
chunk is enrypted individually.
mlx5 library contains som

module/accel: Add mlx5 accel module

The mlx5 accel module supports crypto operations.
Data buffer is split into `block_size` chunks and each
chunk is enrypted individually.
mlx5 library contains some utility functions that will
later be used by other libraries, this lib will be
exntended later.

Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com>
Change-Id: Iacdd8caaade477277d5a95cfd53e9910e280a73b
Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/15420
Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
Reviewed-by: Paul Luse <paul.e.luse@intel.com>
Reviewed-by: Ben Walker <benjamin.walker@intel.com>
Reviewed-by: Jim Harris <james.r.harris@intel.com>

show more ...