Changes in Makefile

2dc4a231ac65d10dd2e1a96684094bef1b7ebb95 - blob: Add support for variable metadata page size

Tue, 22 Oct 2024 21:20:10 +0000

blob: Add support for variable metadata page sizeCurrently SPDK blobstore depends on 4KB atomicity of metadata.So, Metadata page size will be made variable based on the physicalblock size reported by the underlying device. This will enableblobstore to store metadata in IU-sized chunks, not always 4KB.blobstore.c uses SPDK_BS_PAGE_SIZE (4KB) hardcoded at many places.To remove this make the metadata page size variable,phys_blocklen is added to spdk_bs_dev struct andmd_page_size is added to spdk_bs_super_block struct.Change-Id: I29d073eb4f4341a94a0675e70492b9186382f97fSigned-off-by: Atul Malakar Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/25130Community-CI: Broadcom CI Community-CI: Mellanox Build BotReviewed-by: Ben Walker Tested-by: SPDK CI Jenkins Community-CI: Community CI Samsung Reviewed-by: Konrad Sztyber Reviewed-by: Jim Harris List of files: /spdk/lib/lvol/Makefile

355312bfcd3751f9af17fbefc90373fb8a269614 - so_ver: increase all major versions after SPDK 24.01

Fri, 26 Jan 2024 11:19:16 +0000

so_ver: increase all major versions after SPDK 24.01To allow SO_MINOR updates on LTS for the whole year it is supported,the major version for all components needs to be increased.This is to prevent scenario where two versions exists with matchingversions, but conflicting ABI.Ex. Next SPDK release adds an API call increasing the minor version,then LTS needs just a subset of those additions.Increasing major so version after LTS, allows the future releasesto update versions as needed. Yet allowing LTS to increase minorversion separately.This patch:- increases SO_VER by 1 for all components- resets SO_MINOR to 0 for all componentsDue to patch below being introduced after v24.01 code freeze,bdev lib version should not be increased:61623c5ca9 bdev: add spdk_bdev_io padding in place of io_submit_chShort reference to how the versions were changed:MAX=$(git grep "SO_VER := " | cut -d" " -f 3 | sort -ubnr | head -1)for((i=$MAX;i>0;i-=1)); do find . -name "Makefile" -exec \ sed -i -e "s/SO_VER := $i\$/SO_VER := $(($i+1))/g" {} +; donefind . -name "Makefile" -exec \ sed -i -e "s/SO_MINOR := .*/SO_MINOR := 0/g" {} +Signed-off-by: Tomasz Zawadzki Change-Id: I0166d6be6c17bbbf985d48b5dfcb36f1d4af1b48Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/21582Reviewed-by: Konrad Sztyber Tested-by: SPDK CI Jenkins List of files: /spdk/lib/lvol/Makefile

ad5fc351dd221a287cce269ad0e50b11253cc48b - bdev/lvol: use spdk_bs_grow_live() in grow lvs RPC

Thu, 19 Oct 2023 17:08:22 +0000

bdev/lvol: use spdk_bs_grow_live() in grow lvs RPCThis patch adds spdk_lvs_grow_live() pipes through tospdk_bs_grow_live() and use it whenbdev_lvol_grow_lvstore RPC is called.Growing the size of lvs still needs to be explicitRPC call by the user.Moved include for blob_bdev.h to header of the wholebdev module. This way spdk_bdev_update_bs_blockcnt()can be called when RPC is called.Please note that there already exists a test with thisRPC - blobstore_grow.sh. Next patch in seriesadds test calling grow while I/O is being performed.Signed-off-by: Tomasz Zawadzki Change-Id: I9e896c65a8b017d0d20b77d3758901e588e9e70cReviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/20322Community-CI: Mellanox Build BotTested-by: SPDK CI Jenkins Reviewed-by: Jim Harris Reviewed-by: Shuhei Matsumoto List of files: /spdk/lib/lvol/Makefile

3359bf34d682202107c227ea42ace1c600a04657 - so_ver: increase all major versions

Mon, 23 Jan 2023 17:24:28 +0000

so_ver: increase all major versionsTo allow SO_MINOR updates on LTS for the whole year it is supported,the major version for all components needs to be increased.This is to prevent scenario where two versions exists with matchingversions, but conflicting ABI.Ex. Next SPDK release adds an API call increasing the minor version,then LTS needs just a subset of those additions.Increasing major so version after LTS, allows the future releasesto update versions as needed. Yet allowing LTS to increase minorversion separately.Disabled test for increasing SO version without ABI change, asthat is goal of this patch. This check shall be removed with SPDK 23.05release.Looks like this was left over from prior LTS, to avoid thatmake sure it is only skipped when running against v23.01.x as latestrelease.This patch:- increases SO_VER by 1 for all components- resets SO_MINOR to 0 for all components- removes suppressions for ABI testsShort reference to how the versions were changed:MAX=$(git grep "SO_VER := " | cut -d" " -f 3 | sort -ubnr | head -1)for((i=$MAX;i>0;i-=1)); do find . -name "Makefile" -exec \ sed -i -e "s/SO_VER := $i\$/SO_VER := $(($i+1))/g" {} +; donefind . -name "Makefile" -exec \ sed -i -e "s/SO_MINOR := .*/SO_MINOR := 0/g" {} +Change-Id: I3e5681802c0a5ac6d7d652a18896997cd07cc8bfSigned-off-by: Tomasz Zawadzki Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/16419Reviewed-by: Ben Walker Reviewed-by: Konrad Sztyber Tested-by: SPDK CI Jenkins List of files: /spdk/lib/lvol/Makefile

9e843fdbd1f39af220e39a0a31ce33c91c89b902 - blob: Add translate_lba operation

Thu, 15 Sep 2022 21:56:12 +0000

blob: Add translate_lba operationNew `translate_lba` operation allows to translate blob lba to lba onthe underlying bdev. It recurses down the whole chain of bs_dev's. Theoperation may fail to do the translation when blob lba is not backedby the real bdev. For example, when we eventually hit zeroes device inthe chain.This operation is used in the next commit to get source LBA for copyoperation.Signed-off-by: Evgeniy Kochetov Change-Id: I89c2d03d1982d66b9137a3a3653a98c361984fabReviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/14528Tested-by: SPDK CI Jenkins Reviewed-by: Jim Harris Reviewed-by: Shuhei Matsumoto Reviewed-by: Aleksey Marchuk List of files: /spdk/lib/lvol/Makefile

a6dbe3721eb3b5990707fc3e378c95e505dd8ab5 - update Intel copyright notices

Tue, 01 Nov 2022 20:26:26 +0000

update Intel copyright noticesper Intel policy to include file commit date using git cmdbelow. The policy does not apply to non-Intel (C) notices.git log --follow -C90% --format=%ad --date default | tail -1and then pull just the 4 digit year from the result.Intel copyrights were not added to files where Intel either hadno contribution ot the contribution lacked substance (ie licenseheader updates, formatting changes, etc). Contribution date used"--follow -C95%" to get the most accurate date.Note that several files in this patch didn't end the license/(c)block with a blank comment line so these were added as the vastmajority of files do have this last blank line. Simply there forconsistency.Signed-off-by: paul luse Change-Id: Id5b7ce4f658fe87132f14139ead58d6e285c04d4Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/15192Tested-by: SPDK CI Jenkins Reviewed-by: Jim Harris Reviewed-by: Ben Walker Community-CI: Mellanox Build Bot List of files: /spdk/lib/lvol/Makefile

88833020ebc49cbd2d241b3cfa39745009140091 - blobstore: reserve space for growing blobstore

Sun, 10 Apr 2022 05:56:26 +0000

blobstore: reserve space for growing blobstoreReserve space for used_cluster bitmap. The reserved space is calculatedaccording to the num_md_pages. The reserved space would be used whenthe blobstore is extended in the future.Add the num_md_pages_per_cluster_ratio parameter to thebdev_lvol_create_lvstore API. Then calculate the num_md_pagesaccording to the num_md_pages_per_cluster_ratio and bdev total size, thenpass the num_md_pages to the blobstore.Signed-off-by: Peng Yu Change-Id: I61a28a3c931227e0fd3e1ef6b145fc18a3657751Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/9517Tested-by: SPDK CI Jenkins Community-CI: Broadcom CI Community-CI: Mellanox Build BotReviewed-by: Jim Harris Reviewed-by: Ben Walker List of files: /spdk/lib/lvol/Makefile

488570ebd418ba07c9e69e65106dcc964f3bb41b - Replace most BSD 3-clause license text with SPDX identifier.

Fri, 03 Jun 2022 19:15:11 +0000

Replace most BSD 3-clause license text with SPDX identifier.Many open source projects have moved to using SPDX identifiersto specify license information, reducing the amount ofboilerplate code in every source file. This patch replacesthe bulk of SPDK .c, .cpp and Makefiles with the BSD-3-Clauseidentifier.Almost all of these files share the exact same license text,and this patch only modifies the files that contain themost common license text. There can be slight variationsbecause the third clause contains company names - most say"Intel Corporation", but there are instances for Nvidia,Samsung, Eideticom and even "the copyright holder".Used a bash script to automate replacement of the license textwith SPDX identifier which is checked into scripts/spdx.sh.Signed-off-by: Jim Harris Change-Id: Iaa88ab5e92ea471691dc298cfe41ebfb5d169780Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/12904Community-CI: Broadcom CI Community-CI: Mellanox Build BotTested-by: SPDK CI Jenkins Reviewed-by: Aleksey Marchuk Reviewed-by: Changpeng Liu Reviewed-by: Dong Yi Reviewed-by: Konrad Sztyber Reviewed-by: Paul Luse Reviewed-by: List of files: /spdk/lib/lvol/Makefile

047c067c05ff22df06c053990998184b8a940514 - so_ver: increase all major versions

Mon, 31 Jan 2022 09:55:58 +0000

so_ver: increase all major versionsTo allow SO_MINOR updates on LTS for the whole year it is supported,the major version for all components needs to be increased.This is to prevent scenario where two versions exists with matchingversions, but conflicting ABI.Ex. Next SPDK release adds an API call increasing the minor version,then LTS needs just a subset of those additions.Increasing major so version after LTS, allows the future releasesto update versions as needed. Yet allowing LTS to increase minorversion separately.Disabled test for increasing SO version without ABI change, asthat is goal of this patch. This check shall be removed with SPDK 22.05release.This patch:- increases SO_VER by 1 for all components- resets SO_MINOR to 0 for all components- removes suppressions for ABI testsSigned-off-by: Tomasz Zawadzki Change-Id: Id1a5358882dc496faa5b0b5c9a63b326c378c551Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/11361Tested-by: SPDK CI Jenkins Community-CI: Broadcom CI Reviewed-by: Jim Harris Reviewed-by: Ben Walker List of files: /spdk/lib/lvol/Makefile

f01146ae48b78dc5d62db2e0d8050eeabf369e34 - blob: use uint64_t for unmap and write_zeroes lba count

Tue, 05 Oct 2021 23:37:19 +0000

blob: use uint64_t for unmap and write_zeroes lba countPrevious patches (5363eb3c) tried to work around the32-bit unmap and write_zeroes LBA counts by breakingup larger operations into smaller chunks of max sizeUINT32_MAX lba chunks.But some SSDs may just ignore unmap operations thatare not aligned to full physical block boundaries -and a UINT32_MAX lba unmap on a 512B logical /4KiB physical SSD would not be aligned. If the SSDdecided to ignore the unmap/deallocate (which it isallowed to do according to NVMe spec), we could endup with not unmapping *any* blocks. Probably SSDsshould always be trying hard to unmap as manyblocks as possible, but let's not try to depend onthat in blobstore.So one option would be to break them into chunksclose to UINT32_MAX which are still aligned to4KiB boundaries. But the better fix is to justchange the unmap and write_zeroes APIs to take64-bit arguments, and then we can avoid thechunking altogether.Fixes issue #2190.Signed-off-by: Jim Harris Change-Id: I23998e493a764d466927c3520c7a8c7f943000a6Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/9737Community-CI: Broadcom CI Community-CI: Mellanox Build BotReviewed-by: Xiaodong Liu Reviewed-by: Changpeng Liu Reviewed-by: Aleksey Marchuk Reviewed-by: Dong Yi Reviewed-by: Ben Walker Reviewed-by: Tomasz Zawadzki Tested-by: SPDK CI Jenkins List of files: /spdk/lib/lvol/Makefile

e4070ee0e012c345f4c059f125f4f9ce3be66690 - so_ver: increase all major versions

Fri, 29 Jan 2021 10:11:25 +0000

so_ver: increase all major versionsTo allow SO_MINOR updates on LTS for the whole year it is supported,the major version for all components needs to be increased.This is to prevent scenario where two versions exists with matchingversions, but conflicting ABI.Ex. Next SPDK release adds an API call increasing the minor version,then LTS needs just a subset of those additions.Increasing major so version after LTS, allows the quarterly releasesto update versions as needed. Yet allowing LTS to increase minorversion separately.Disabled test for increasing SO version without ABI change, asthat is goal of this patch. This check shall be removed with SPDK 21.04release.This patch:- increases SO_VER by 1 for all components- resets SO_MINOR to 0 for all components- removes suppressions for ABI testsSigned-off-by: Tomasz Zawadzki Change-Id: I44d01154430a074103bd21c7084f44932e81fe72Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/6167Community-CI: Broadcom CICommunity-CI: Mellanox Build BotTested-by: SPDK CI Jenkins Reviewed-by: Ben Walker Reviewed-by: Jim Harris List of files: /spdk/lib/lvol/Makefile

296a6d98389b7cbf95f57fc05c3565c2d65229e5 - bdev: extend interface with get module ctx

Tue, 27 Oct 2020 16:13:54 +0000

bdev: extend interface with get module ctxCurrently only nvme bdev module implements this interface. Bdev modulecontext (in this case spdk_nvme_ctrlr opaque handle) allows for nvmeinterface usage for additional management.Signed-off-by: Jacek Kalwas Change-Id: I6302c9229d5f7f294a3c1472d9e8dc1519637ffbReviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4924Tested-by: SPDK CI Jenkins Reviewed-by: Tomasz Zawadzki Reviewed-by: Shuhei Matsumoto Reviewed-by: Aleksey Marchuk List of files: /spdk/lib/lvol/Makefile

d18e63206a4b5d710756d7e7d9c42ef0db0c5d58 - mk/lib: add a check that major and minor version is set for libs.

Sun, 10 May 2020 20:40:09 +0000

mk/lib: add a check that major and minor version is set for libs.Also, while we are here, consolidate setting SO_SUFFIX to one spot.Previously, it was possible for a library to slip throughwithout an SO version.Signed-off-by: Seth Howell Change-Id: I4db5fa5839502d266c6259892e5719b05134518cReviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/2361Tested-by: SPDK CI Jenkins Community-CI: Mellanox Build BotCommunity-CI: Broadcom CIReviewed-by: Paul Luse Reviewed-by: Ben Walker Reviewed-by: Aleksey Marchuk Reviewed-by: Tomasz Zawadzki List of files: /spdk/lib/lvol/Makefile

bbb6368e42a1e47d171394d12ca049b58aa6fae6 - lib/lvol: add a map file.

Thu, 07 May 2020 17:06:34 +0000

lib/lvol: add a map file.Signed-off-by: Seth Howell Change-Id: Iec2a50ca4af8fe24f011d4cc6e04606115ba45a0Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/2237Community-CI: Mellanox Build BotTested-by: SPDK CI Jenkins Reviewed-by: Shuhei Matsumoto Reviewed-by: Jim Harris List of files: /spdk/lib/lvol/Makefile

193927830ddced41dfebfe7cdb14d543aaf84a2c - make: rev SO versions individually for libraries.

Fri, 28 Feb 2020 20:47:11 +0000

make: rev SO versions individually for libraries.This will allow us to keep track of compatibility issues on aper-library basis.Change-Id: Ib0c796adb1efe1570212a503ed660bef6f142b6eSigned-off-by: Seth Howell Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/1067Tested-by: SPDK CI Jenkins Reviewed-by: Jim Harris Reviewed-by: Ben Walker List of files: /spdk/lib/lvol/Makefile

543cb17248ab28373fe73dc29332819817aa7d5e - build: remove $(ENV_CFLAGS) where not necessary

Mon, 11 Dec 2017 22:38:24 +0000

build: remove $(ENV_CFLAGS) where not necessaryOnly Makefiles for libraries that directly depend on DPDK (rather thanthe SPDK env abstraction) should add $(ENV_CFLAGS).Change-Id: Ifdf44d3ef8c42bbf7f20edd524b330d00658235bSigned-off-by: Daniel Verkamp Reviewed-on: https://review.gerrithub.io/392818Tested-by: SPDK Automated Test System Reviewed-by: Ben Walker Reviewed-by: Jim Harris List of files: /spdk/lib/lvol/Makefile

27f44662ac3c678828bcd13fe8533ec97426082e - lvol: Logical volume implementation

Thu, 14 Sep 2017 14:53:36 +0000

lvol: Logical volume implementationChange-Id: Ia96ae78ff9530d953181ac5f7255a38f3c8ec430Signed-off-by: Tomasz Zawadzki Signed-off-by: Maciej Szwed Signed-off-by: Piotr Pelplinski Reviewed-on: https://review.gerrithub.io/375392Tested-by: SPDK Automated Test System Reviewed-by: Daniel Verkamp Reviewed-by: Jim Harris List of files: /spdk/lib/lvol/Makefile