| 277bf354 | 22-Nov-2023 |
Srikanth Yalavarthi <syalavarthi@marvell.com> |
ml/cnxk: fix reading model and layer ID
Using model_id from op structure as layer index for TVM models with multiple MRVL layers is incorrect. This patch fixes the issue by reading the layer index f
ml/cnxk: fix reading model and layer ID
Using model_id from op structure as layer index for TVM models with multiple MRVL layers is incorrect. This patch fixes the issue by reading the layer index from the job descriptor structure.
Fixes: 31cc30b5f088 ("ml/cnxk: update model start/stop functions")
Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
show more ...
|
| c5586f49 | 26-Oct-2023 |
Anup Prabhu <aprabhu@marvell.com> |
ml/cnxk: enable fast-path ops for TVM models
Enable fast-path ops support for TVM models. Models would use TVMDP library function calls to execute inference operations for Hybrid and LLVM model sub-
ml/cnxk: enable fast-path ops for TVM models
Enable fast-path ops support for TVM models. Models would use TVMDP library function calls to execute inference operations for Hybrid and LLVM model sub-types.
For TVM MRVL model subtypes that have a single MRVL layer, the inference requests are directly enqueued to hardware by the driver.
Signed-off-by: Anup Prabhu <aprabhu@marvell.com> Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
show more ...
|