Changes in conf-generator

dfb2950fd5b13ba0a2a2b533e3e534202a89de74 - scripts/check_format: Adjust bash code to adhere to shfmt v3.8.0

Mon, 13 May 2024 12:44:06 +0000

scripts/check_format: Adjust bash code to adhere to shfmt v3.8.0This bump ensures some of the obscure formatting bugs are finallysquashed. All the adjustments introduced here adhere to what wealready try to enforce across the entire repo, but due to said bugscould not be implemented.Remove SHFMT_NO_EDITORCONFIG since it's not supported in latestshfmt releases.This patch doesn't introduce any functional change in the updatedfiles.Change-Id: Ia2b011b86c8fe12376c4a8455ee638473a9f7179Signed-off-by: Michal Berger Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/23088Tested-by: SPDK CI Jenkins Reviewed-by: Konrad Sztyber Reviewed-by: Tomasz Zawadzki Community-CI: Mellanox Build Bot List of files: /spdk/scripts/perf/vhost/conf-generator

161ef3f541084721ffa9f82a210847d878d228f7 - scripts/perf: Rename vhost_master_core to vhost_main_core

Wed, 24 Jan 2024 11:37:11 +0000

scripts/perf: Rename vhost_*master_core to vhost_*main_coreThe initial implementation was based out of custom CI configurationwhich was not changed after the following commit: https://review.spdk.io/gerrit/c/spdk/spdk/+/5353So fix it now.Change-Id: Ib5fcfc0d6535019c22066ccf36aabe6748c699e1Signed-off-by: Michal Berger Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/21546Reviewed-by: Konrad Sztyber Reviewed-by: Jim Harris Tested-by: SPDK CI Jenkins List of files: /spdk/scripts/perf/vhost/conf-generator

b86184c51d343f1f20fd23a9d6ab2f79666df894 - test/vhost: Add cpu gen wrapper around conf-generator

Sat, 13 Jan 2024 14:15:48 +0000

test/vhost: Add cpu gen wrapper around conf-generatorThe goal here is to not use a static cpu configuration in vhosttests, but rather determine it dynamically based on the underlyingtopology.Also, change vm[N]_node override var to VM[N]_NODE as existingimplementation didn't really allow the user to override the nodethis way (since it was explicitly set by the conf-generator whileconstructing initial NUMA-aware setup).Change-Id: I791afaa8ebbd77de85d1e29c2fa43d442c22cac8Signed-off-by: Michal Berger Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/21420Tested-by: SPDK CI Jenkins Reviewed-by: Tomasz Zawadzki Reviewed-by: Konrad Sztyber List of files: /spdk/scripts/perf/vhost/conf-generator

48945e3dac01fcaf0ec733a3451a3764f9614d81 - perf/vhost: Add nullglob,extglob opts

Tue, 14 Nov 2023 13:10:30 +0000

perf/vhost: Add nullglob,extglob optsPreviously conf-generator did depend on these being set by thescheduler/common.sh, but since the:https://review.spdk.io/gerrit/c/spdk/spdk/+/19551these were moved to autotest_common.sh. conf-generator is notmeant to use it, so enable these opts directly inside of it.Change-Id: I00a70250e2b240e27345a344848deb0fc406209eSigned-off-by: Michal Berger Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/20581Reviewed-by: Konrad Sztyber Reviewed-by: Tomasz Zawadzki Tested-by: SPDK CI Jenkins List of files: /spdk/scripts/perf/vhost/conf-generator

cca7c14ae8a768e25583a51e0211860a9284b870 - scripts/perf: Allow to override number of VMs to be pinned to nvme

Mon, 08 May 2023 20:49:10 +0000

scripts/perf: Allow to override number of VMs to be pinned to nvmeTargeted for the vhost's TC3 use-case where single drive should besplit along multiple VMs. E.g.: # vm_count=2 ./conf-generator -p disk # Generated automatically by conf-generator # NVMe Drives: 2 VM count: 2 0000:17:00.0,Nvme0,1,0 0000:18:00.0,Nvme1,1,1vs # vms_per_nvme=2 vm_count=2 ./conf-generator -p disk # Generated automatically by conf-generator # NVMe Drives: 1 VM count: 2 0000:17:00.0,Nvme0,2,0 1Change-Id: I68ccaab896b763534cedbeac0331218b73cff454Signed-off-by: Michal Berger Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/17982Reviewed-by: Karol Latecki Tested-by: SPDK CI Jenkins Reviewed-by: Konrad Sztyber Reviewed-by: Jim Harris List of files: /spdk/scripts/perf/vhost/conf-generator

c1e9ed6d4c53fd0272f4ba9e2e40295be440f466 - perf/vhost: Auto generate VM cpu and disk map configs

Thu, 20 Oct 2022 10:54:54 +0000

perf/vhost: Auto generate VM cpu and disk map configsThe configuration is generated based on existing host's NUMAtopology (as seen via sysfs) instead of a total number of cpus asit was done before. New logic attempts to load balance VMs andtheir cpus based on nvme drives' NUMA location. If there is noenough cpus left under the target node, all remaining nodes arechecked. For the sake of the performance, cpus are not mixedbetween different numa nodes.Disk map is created by mapping VMs to existing nvme drivesbased on their NUMA location. Extra VMs are assigned in busorder of the nvme drives.SPDK cpus are split by matching the VM-to-nvme NUMA ratio.Static list can be defined as well to override this behavior.https://trello.com/c/HSoRtQkO/401-deprecate-vhost-performance-python-helper-scriptSigned-off-by: Michal Berger Change-Id: Ia63c6f9a472a685d252efd110eaba7b114a87d2cReviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/12401Tested-by: SPDK CI Jenkins Reviewed-by: Tomasz Zawadzki Reviewed-by: Jim Harris Reviewed-by: Karol Latecki List of files: /spdk/scripts/perf/vhost/conf-generator