app/mldev: fix check for file list and models count

Fix incorrect check for filelist and models count.

Fixes: bbd272edcb14 ("app/mldev: add ordered inferences")
Fixes: f6661e6d9a3a ("app/mldev: val

app/mldev: fix check for file list and models count

Fix incorrect check for filelist and models count.

Fixes: bbd272edcb14 ("app/mldev: add ordered inferences")
Fixes: f6661e6d9a3a ("app/mldev: validate model operations")
Cc: stable@dpdk.org

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
Acked-by: Anup Prabhu <aprabhu@marvell.com>
Acked-by: Shivah Shankar S <sshankarnara@marvell.com>

show more ...

app/mldev: support pre-quantized I/O

Enabled support for pre-quantized input and output in ML
test application.

Signed-off-by: Anup Prabhu <aprabhu@marvell.com>
Acked-by: Shivah Shankar S <sshankar

app/mldev: support pre-quantized I/O

Enabled support for pre-quantized input and output in ML
test application.

Signed-off-by: Anup Prabhu <aprabhu@marvell.com>
Acked-by: Shivah Shankar S <sshankarnara@marvell.com>

show more ...

mldev: introduce IO layout

Introduce IO layout in ML device specification.
IO layout defines the expected arrangement of model input and output
buffers in the memory.
Packed and Split layout support

mldev: introduce IO layout

Introduce IO layout in ML device specification.
IO layout defines the expected arrangement of model input and output
buffers in the memory.
Packed and Split layout support is added in the specification.

Updated rte_ml_op to support array of rte_ml_buff_seg
pointers to support packed and split I/O layouts.
Updated ML quantize and dequantize APIs to support rte_ml_buff_seg
pointer arrays.
Replaced batch_size with min_batches and max_batches in rte_ml_model_info.

Implement support for model IO layout in ml/cnxk driver.
Updated the ML test application to support IO layout and
dropped support for '--batches' in test application.

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
Acked-by: Shivah Shankar S <sshankarnara@marvell.com>

show more ...

app/mldev: improve checks for invalid options

Improve checks for ML application options. Check for negative,
non-integral and hexadecimal values. Check for number of entries
in filelist option. Impr

app/mldev: improve checks for invalid options

Improve checks for ML application options. Check for negative,
non-integral and hexadecimal values. Check for number of entries
in filelist option. Improve error reporting for invalid options.

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>

show more ...

app/mldev: fix code formatting and typos

Updated ML application source files to have uniform code formatting
style across. Remove extra blank lines. Fix typos in application help.

Fixes: 8cb22a5454

app/mldev: fix code formatting and typos

Updated ML application source files to have uniform code formatting
style across. Remove extra blank lines. Fix typos in application help.

Fixes: 8cb22a545447 ("app/mldev: fix debug build")
Fixes: da6793390596 ("app/mldev: support inference validation")
Fixes: c0e871657d6a ("app/mldev: support queue pairs and size")
Cc: stable@dpdk.org

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>

show more ...

app/mldev: enable reporting xstats

Enabled reporting xstats in ML test application. Enabled
stats option for model_ops test case. Added common files
for xstats and throughput functions.

Signed-off-

app/mldev: enable reporting xstats

Enabled reporting xstats in ML test application. Enabled
stats option for model_ops test case. Added common files
for xstats and throughput functions.

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>

show more ...

app/mldev: add statistics

Enable reporting driver xstats and inference end-to-end
latency and throughput in mldev inference tests. Reporting
of stats can be enabled using "--stats" option.

Signed-o

app/mldev: add statistics

Enable reporting driver xstats and inference end-to-end
latency and throughput in mldev inference tests. Reporting
of stats can be enabled using "--stats" option.

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
Acked-by: Anup Prabhu <aprabhu@marvell.com>

show more ...

app/mldev: support inference validation

Enabled support to validate inference output with reference
output provided by the user. Validation would be successful
only when the inference outputs are wi

app/mldev: support inference validation

Enabled support to validate inference output with reference
output provided by the user. Validation would be successful
only when the inference outputs are within the 'tolerance'
specified through command line option "--tolerance".

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
Acked-by: Anup Prabhu <aprabhu@marvell.com>

show more ...

app/mldev: support inference batches

Enabled support to execute multiple batches of inferences
per each enqueue request. Input and reference for the test
should be appropriately provided for multi-b

app/mldev: support inference batches

Enabled support to execute multiple batches of inferences
per each enqueue request. Input and reference for the test
should be appropriately provided for multi-batch run. Number
of batches can be specified through "--batches" option.

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
Acked-by: Anup Prabhu <aprabhu@marvell.com>

show more ...

app/mldev: support queue pairs and size

Added support to create multiple queue-pairs per device to
enqueue and dequeue inference requests. Number of queue pairs
to be created can be specified throug

app/mldev: support queue pairs and size

Added support to create multiple queue-pairs per device to
enqueue and dequeue inference requests. Number of queue pairs
to be created can be specified through "--queue_pairs" option.
Support is also enabled to control the number of descriptors
per each queue pair through "--queue_size" option. Inference
requests for a model are distributed across all available
queue-pairs.

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
Acked-by: Anup Prabhu <aprabhu@marvell.com>

show more ...

app/mldev: support for burst inferences

Added 'burst_size' support for inference tests. Burst size
controls the number of inference requests handled during
the burst enqueue and dequeue operations o

app/mldev: support for burst inferences

Added 'burst_size' support for inference tests. Burst size
controls the number of inference requests handled during
the burst enqueue and dequeue operations of the test case.

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
Acked-by: Anup Prabhu <aprabhu@marvell.com>

show more ...

app/mldev: add interleave inferences

Added test case to interleave inference requests from multiple
models. Interleaving would load and start all models and launch
inference requests for the models

app/mldev: add interleave inferences

Added test case to interleave inference requests from multiple
models. Interleaving would load and start all models and launch
inference requests for the models using available queue-pairs

Operations sequence when testing with N models and R reps,

(load + start) x N -> (enqueue + dequeue) x N x R ...
-> (stop + unload) x N

Test can be executed by selecting "inference_interleave" test.

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
Acked-by: Anup Prabhu <aprabhu@marvell.com>

show more ...

app/mldev: add ordered inferences

Added an ordered test case to execute inferences with single
or multiple models. In this test case inference requests for
a model are enqueued after completion of a

app/mldev: add ordered inferences

Added an ordered test case to execute inferences with single
or multiple models. In this test case inference requests for
a model are enqueued after completion of all requests for
the previous model. Test supports inference repetitions.

Operations sequence when testing with N models and R reps,

(load -> start -> (enqueue + dequeue) x R -> stop -> unload) x N

Test case can be executed by selecting "inference_ordered" test
and repetitions can be specified through "--repetitions" argument.

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
Acked-by: Anup Prabhu <aprabhu@marvell.com>

show more ...

app/mldev: validate model operations

Added test case to validate model operations. Model ops test
is a collection of sub-tests. Each sub-test invokes the model
operations in a specific order.

Sub-t

app/mldev: validate model operations

Added test case to validate model operations. Model ops test
is a collection of sub-tests. Each sub-test invokes the model
operations in a specific order.

Sub-test A: (load -> start -> stop -> unload) x n
Sub-test B: load x n -> start x n -> stop x n -> unload x n
Sub-test C: load x n + (start + stop) x n + unload x n
Sub-test D: (load + start) x n -> (stop + unload) x n

Added internal functions to handle model load, start, stop and
unload. List of models to be used for testing can be specified
through application argument "--models"

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
Acked-by: Anup Prabhu <aprabhu@marvell.com>

show more ...

app/mldev: validate device operations

Added test case to validate device handling operations. Device ops
test is a collection of multiple sub-tests. Enabled sub-test to
validate device reconfigurati

app/mldev: validate device operations

Added test case to validate device handling operations. Device ops
test is a collection of multiple sub-tests. Enabled sub-test to
validate device reconfiguration. Set device_ops as the default test.

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
Acked-by: Anup Prabhu <aprabhu@marvell.com>

show more ...

app/mldev: introduce test framework for mldev

Implemented framework for mldev test application. New test cases
can be added using the framework. Support is also enabled to add
options specific to th

app/mldev: introduce test framework for mldev

Implemented framework for mldev test application. New test cases
can be added using the framework. Support is also enabled to add
options specific to the test cases. User can launch the tests by
specifying the name of test as part of launch arguments.

Code to parse command line arguments is imported from
test-eventdev, with support to parse additional data types.

Common arguments supported include:

test : name of the test application to run
dev_id : device id of the ML device
socket_id : socket_id of application resources
debug : enable debugging
help : print help

Sample launch command:
./dpdk-test-mldev -- --test <testname> --dev_id <dev_id> \
--socket_id <socket_id>

Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
Acked-by: Shivah Shankar S <sshankarnara@marvell.com>
Acked-by: Anup Prabhu <aprabhu@marvell.com>

show more ...