tmakatos · benlwalker · Aug 13, 2020 · Aug 11, 2020 · Aug 10, 2020 · Jul 21, 2020
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -1,33 +1,40 @@
 # Changelog
 
-## v20.07: (Upcoming Release)
+## v20.10: (Upcoming Release)
 
-### nvmf
+### bdev
 
-The NVMe-oF target no longer supports connecting scheduling configuration and instead
-always uses what was previously called "transport" scheduling.
+A new API was added `bdev_examine_bdev` that allows users to examine a
+bdev explicitly. It can be used only if auto_examine is disabled.
 
 `spdk_nvmf_tgt_accept` no longer exists. The accept process now occurs automatically after
 the creation of an nvmf target and queue pairs are assigned to poll groups by the underlying
 transport. Further, `spdk_nvmf_transport_ops` has changed such that the accept function
 pointer no longer takes a function pointer as an argument. Instead, transports should call
 `spdk_nvmf_tgt_new_qpair` whenever they previously would have called that callback.
 
-### nvme
+Updated DPDK submodule to DPDK 20.08.
 
-Add `opts_size` in `spdk_nvme_ctrlr_opts` structure in order to solve the compatiblity issue
-for different ABI version.
+### isa-l
 
-### RPC
+Updated ISA-L submodule to v2.29.0.
 
-Command line parameters `-r` and `--rpc-socket` will longer accept TCP ports. RPC server
-must now be started on a Unix domain socket. Exposing RPC on the network, as well as providing
-proper authentication (if needed) is now a responsibility of the user.
+### ocf
 
-### build
+Updated OCF submodule to v20.03.1
 
-The fio plugins now compile to `build/fio` and are named `spdk_bdev` and `spdk_nvme`.
-Existing fio configuration files will need to be updated.
+### sock
+
+The `enable_placement_id` field was added in the struct spdk_sock_impl_opts to
+make the placement_id feature configurable by users. The default setting is
+not enabled.
+
+### rpc
+
+A new optional parameter `enable_placement_id` was added to the `sock_impl_set_options`
+RPC.
+
+## v20.07: SPDK CSI driver, new accel_fw commands, I/O abort support
 
 ### accel
 
@@ -42,15 +49,87 @@ A new capability, compare, was added via `spdk_accel_submit_compare`.
 
 The software accel engine implemenation has added support for compare.
 
+Several APIs were added to `accel_engine.h` to support batched submission
+of operations.
+
+Several APIs were added to `accel_engine.h` to support dualcast operations.
+
+### accel_fw
+
+The accel_fw was updated to no longer require the app to allocate an
+accel_task on its behalf. All public APIs now take a callback arg as
+the parameter that used to be the accel_task.
+
+The accel_fw API `spdk_accel_task_size` was removed as it is no longer
+required.
+
+The accel_fw was updated to support compare, dualcast, crc32c.
+
+The accel_fw introduced batching support for all commands in all plug-ins.
+See docs for detailed information.
+
+### bdev
+
+A new API `spdk_bdev_abort` has been added to submit abort requests to abort all I/Os
+whose callback context match to the bdev on the given channel.
+
+### build
+
+The fio plugins now compile to `build/fio` and are named `spdk_bdev` and `spdk_nvme`.
+Existing fio configuration files will need to be updated.
+
 ### dpdk
 
-Updated DPDK submodule to DPDK 19.11.2, which includes fixes for DPDK vulnerabilities:
-CVE-2020-10722, CVE-2020-10723, CVE-2020-10724, CVE-2020-10725, CVE-2020-10724.
+Updated DPDK submodule to DPDK 20.05.
+
+### env
+
+Several new APIs have been added to provide greater flexibility in registering and
+accessing polled mode PCI drivers. See `env.h` for more details.
 
 ### idxd
 
+The idxd library and plug-in module for the accel_fw were updated to support
+all accel_fw commands as well as batching.  Batching is supported both
+through the library and the plug-in module.
+
 IDXD engine support for CRC-32C has been added.
 
+### ioat
+
+A new API `spdk_ioat_get_max_descriptors` was added.
+
+### nvme
+
+An `opts_size`element was added in the  `spdk_nvme_ctrlr_opts` structure
+to solve the ABI compatiblity issue between different SPDK version.
+
+A new API `spdk_nvme_ctrlr_cmd_abort_ext` has been added to abort previously submitted
+commands whose callback argument match.
+
+Convenience functions, `spdk_nvme_print_command` and `spdk_nvme-print_completion` were added
+to the public API.
+
+A new function, `spdk_nvmf_cuse_update_namespaces`, updates the cuse representation of an NVMe
+controller.
+
+A new function `qpair_iterate_requests` has been added to the nvme transport interface. ALl
+implementations of the transport interface will have to implement that function.
+
+### nvmf
+
+The NVMe-oF target no longer supports connecting scheduling configuration and instead
+always uses what was previously called "transport" scheduling.
+
+`spdk_nvmf_tgt_accept` no longer takes a function pointer as an argument. New connections
+are automatically assigned to poll groups by the underlying transport. Further,
+`spdk_nvmf_transport_ops` has changed such that the accept function pointer no longer
+takes a function pointer as an argument. Instead, transports should call
+`spdk_nvmf_tgt_new_qpair` whenever they previously would have called that callback.
+
+The NVMe-oF target now supports aborting any submitted NVM or Admin command. Previously,
+the NVMe-oF target could abort only Asynchronous Event Request commands.
+
 ### rdma
 
 A new `rdma` library has been added. It is an abstraction layer over different RDMA providers.
@@ -61,10 +140,19 @@ Using mlx5_dv requires libmlx5 installed on the system.
 ### rpc
 
 Parameter `-p` or `--max-qpairs-per-ctrlr` of `nvmf_create_transport` RPC command accepted by the
-rpc.py script is deprecated, new parameter `-m` or `--max-io-qpairs-per-ctrlr` is added.
+rpc.py script is deprecated, new parameter `-m` or `--max-io-qpairs-per-ctrlr` was added.
 
-Parameter `max_qpairs_per_ctrlr` of `nvmf_create_transport` RPC command accepted by the NVMF target
-is deprecated, new parameter `max_io_qpairs_per_ctrlr` is added.
+Added `sock_impl_get_options` and `sock_impl_set_options` RPC methods.
+
+Command line parameters `-r` and `--rpc-socket` will longer accept TCP ports. RPC server
+must now be started on a Unix domain socket. Exposing RPC on the network, as well as providing
+proper authentication (if needed) is now a responsibility of the user.
+
+The `bdev_set_options` RPC has a new option, `bdev_auto_examine` to control the auto examine function
+of bdev modules.
+
+New RPCs `sock_impl_get_options` and `sock_impl_set_options` been added to expose new socket features.
+See `sock` section for more details.
 
 ### sock
 
@@ -73,11 +161,26 @@ options. Options can be set independently for each implementation.
 
 Added `recv_buf_size` and 'send_buf_size' socket layer options. They are used only in posix implementation.
 
+Added `uring` based socket implementation, the code is located in module/sock/uring. This feature is only
+available in Linux which requires kernel version is greater than 5.4.3. Currently, our CI pool added the uring
+based socket tests for iSCSI target and also the tests for SPDK NVMe-oF tcp transport.
+
+Added `enable_recv_pipe` socket layer option to allow disabling of double buffering on receive.
+New option is used only in posix implementation.
+
+Added `enable_zerocopy_send` socket layer option to allow disabling of zero copy flow on send.
+New option is used only in posix implementation.
+
+### util
+
+Some previously exposed CRC32 functions have been removed from the public API -
+`spdk_crc32_update`, `spdk_crc32_table_init`, and the `spdk_crc32_table` struct.
+
 ### vhost
 
 The function `spdk_vhost_blk_get_dev` has been removed.
 
-## v20.04:
+## v20.04: SPDK Top, IDXD, NVMe qpair groups
 
 IDXD engine support for compare has been added.
 
@@ -280,7 +383,7 @@ Poll groups per session have been replaced by SPDK threads per vhost controller.
 A new function, `spdk_vmd_fini`, has been added. It releases all resources acquired by the VMD
 library through the `spdk_vmd_init` call.
 
-## v20.01
+## v20.01: Optimized thin provisioning, FTL bdev, VMD hot plug, FUSED support
 
 ### bdev
 
@@ -470,7 +573,7 @@ code for fused compare-and-write operation.
 
 Added spdk_bdev_get_acwu function for getting block device atomic compare and write unit size.
 
-## v19.10
+## v19.10: Zoned bdev API, Opal bdev, NVMe character devices
 
 ### rpc
 
@@ -700,7 +803,7 @@ New cache modes added to use via RPC, wi - write invalidate and wa - write aroun
 
 New version of OCF provides fully asynchronous management API.
 
-## v19.07
+## v19.07: NVMe-oF FC Transport, VMD, NVMe-oF Persistent reservations, Bdev I/O with separate metadata
 
 ### ftl
 
@@ -976,7 +1079,7 @@ with SPDK thread when necessary.
 Added spdk_thread_destroy() to allow framework polling the thread to
 release resources associated with that thread.
 
-## v19.04
+## v19.04: Compression bdev, Notification library, NVMe Opal support
 
 ### nvme
 
@@ -1197,7 +1300,7 @@ Added "reduce" block compression scheme based on using SSDs for storing
 compressed blocks of storage and presistent memory for metadata. Please see
 [compression](https://spdk.io/doc/bdev.html) for more details.
 
-## v19.01
+## v19.01: NVMe-oF TCP/IP Transport, Open Channel SSD Flash Translation Layer, Caching bdev based on OCF, ISA-L Support, DIF/DIX library
 
 ### ocf bdev
 
@@ -1452,7 +1555,7 @@ JSON RPC client is now running in non-blocking mode. Requests are sent and recei
 JSON RPC server can now recieve a callback on connection termination or server shutdown using `spdk_jsonrpc_conn_add_close_cb`
 and `spdk_jsonrpc_conn_del_close_cb`.
 
-## v18.10
+## v18.10: Dynamic memory allocation, Crypto Virtual Bdev, jsonrpc-client, SPDKCLI iSCSI and NVMe-oF support
 
 ### nvme
 
@@ -1649,7 +1752,7 @@ in QEMU.
 The SPDKCLI interactive command tool for managing SPDK is no longer considered experimental.
 Support for the iSCSI and NVMe-oF targets has been added.
 
-## v18.07
+## v18.07: Raid, Infrastructure Improvements, Bug Fixes
 
 ### bdev
 

diff --git a/CONFIG b/CONFIG
@@ -125,10 +125,6 @@ CONFIG_PMDK_DIR=
 # Enable the dependencies for building the compress vbdev
 CONFIG_REDUCE=n
 
-# Build with VPP
-CONFIG_VPP=n
-CONFIG_VPP_DIR=
-
 # Requires libiscsi development libraries.
 CONFIG_ISCSI_INITIATOR=n
 

diff --git a/Makefile b/Makefile
@@ -2,6 +2,7 @@
 #  BSD LICENSE
 #
 #  Copyright (c) Intel Corporation.
+#  Copyright (c) 2020, Mellanox Corporation.
 #  All rights reserved.
 #
 #  Redistribution and use in source and binary forms, with or without
@@ -49,6 +50,9 @@ DIRS-$(CONFIG_ISAL) += isalbuild
 	cc_version cxx_version .libs_only_other .ldflags ldflags install \
 	uninstall
 
+# Workaround for ninja. See dpdkbuild/Makefile
+export MAKE_PID := $(shell echo $$PPID)
+
 ifeq ($(SPDK_ROOT_DIR)/lib/env_dpdk,$(CONFIG_ENV))
 ifeq ($(CURDIR)/dpdk/build,$(CONFIG_DPDK_DIR))
 ifneq ($(SKIP_DPDK_BUILD),1)
@@ -81,6 +85,7 @@ clean: $(DIRS-y)
 	$(Q)rm -rf build/fio
 	$(Q)rm -rf build/examples
 	$(Q)rm -rf build/include
+	$(Q)find build/lib ! -name .gitignore -type f -delete
 
 install: all
 	$(Q)echo "Installed to $(DESTDIR)$(CONFIG_PREFIX)"

diff --git a/app/Makefile b/app/Makefile
@@ -44,6 +44,7 @@ DIRS-y += spdk_lspci
 DIRS-y += spdk_top
 ifeq ($(OS),Linux)
 DIRS-$(CONFIG_VHOST) += vhost
+DIRS-y += spdk_dd
 endif
 
 .PHONY: all clean $(DIRS-y)

diff --git a/app/iscsi_tgt/Makefile b/app/iscsi_tgt/Makefile
@@ -44,7 +44,7 @@ CFLAGS += -I$(SPDK_ROOT_DIR)/lib
 C_SRCS := iscsi_tgt.c
 
 SPDK_LIB_LIST = $(ALL_MODULES_LIST)
-SPDK_LIB_LIST += event_bdev event_accel event_iscsi event_net event_scsi event_vmd event
+SPDK_LIB_LIST += $(EVENT_BDEV_SUBSYSTEM) event_iscsi event_net event_scsi event
 SPDK_LIB_LIST += jsonrpc json rpc bdev_rpc bdev iscsi scsi accel trace conf
 SPDK_LIB_LIST += thread util log log_rpc app_rpc net sock notify
 

diff --git a/app/iscsi_top/Makefile b/app/iscsi_top/Makefile
@@ -36,8 +36,8 @@ include $(SPDK_ROOT_DIR)/mk/spdk.common.mk
 include $(SPDK_ROOT_DIR)/mk/spdk.modules.mk
 
 APP = iscsi_top
+SPDK_NO_LINK_ENV = 1
 
-CXXFLAGS += $(ENV_CXXFLAGS)
 CXXFLAGS += -I$(SPDK_ROOT_DIR)/lib
 
 CXX_SRCS := iscsi_top.cpp

diff --git a/app/nvmf_tgt/Makefile b/app/nvmf_tgt/Makefile
@@ -40,7 +40,7 @@ APP = nvmf_tgt
 C_SRCS := nvmf_main.c
 
 SPDK_LIB_LIST = $(ALL_MODULES_LIST)
-SPDK_LIB_LIST += event_bdev event_accel event_nvmf event_net event_vmd
+SPDK_LIB_LIST += $(EVENT_BDEV_SUBSYSTEM) event_nvmf event_net
 SPDK_LIB_LIST += nvmf event log trace conf thread util bdev accel rpc jsonrpc json net sock
 SPDK_LIB_LIST += app_rpc log_rpc bdev_rpc notify
 

diff --git a/app/spdk_dd/.gitignore b/app/spdk_dd/.gitignore
@@ -0,0 +1 @@
+spdk_dd
diff --git a/app/spdk_dd/Makefile b/app/spdk_dd/Makefile
@@ -0,0 +1,47 @@
+#
+#  BSD LICENSE
+#
+#  Copyright (c) Intel Corporation.
+#  All rights reserved.
+#
+#  Redistribution and use in source and binary forms, with or without
+#  modification, are permitted provided that the following conditions
+#  are met:
+#
+#    * Redistributions of source code must retain the above copyright
+#      notice, this list of conditions and the following disclaimer.
+#    * Redistributions in binary form must reproduce the above copyright
+#      notice, this list of conditions and the following disclaimer in
+#      the documentation and/or other materials provided with the
+#      distribution.
+#    * Neither the name of Intel Corporation nor the names of its
+#      contributors may be used to endorse or promote products derived
+#      from this software without specific prior written permission.
+#
+#  THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
+#  "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
+#  LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
+#  A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
+#  OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
+#  SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
+#  LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
+#  DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
+#  THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+#  (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
+#  OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+#
+
+SPDK_ROOT_DIR := $(abspath $(CURDIR)/../..)
+include $(SPDK_ROOT_DIR)/mk/spdk.common.mk
+include $(SPDK_ROOT_DIR)/mk/spdk.modules.mk
+
+APP = spdk_dd
+
+C_SRCS := spdk_dd.c
+
+SPDK_LIB_LIST = $(ALL_MODULES_LIST)
+SPDK_LIB_LIST += event_sock event_bdev event_accel event_vmd
+SPDK_LIB_LIST += bdev accel event thread util conf trace \
+		log jsonrpc json rpc sock notify
+
+include $(SPDK_ROOT_DIR)/mk/spdk.app.mk