Changes between Version 7 and Version 8 of kinaraai


Ignore:
Timestamp:
02/21/2026 12:18:51 AM (2 hours ago)
Author:
Ryan Erbstoesser
Comment:

close page

Legend:

Unmodified
Added
Removed
Modified

  • kinaraai

    v7 v8  
    1 = Kinara AI
    2 
    3 Create an account at https://support.kinara.ai/
    4 
    5 The ARA2 Quickstart guide is what should be used.
    6 [https://support.kinara.ai/api//assets/sdk/1.3/public/sdk/Ara2-quickstart.html]
    7 
    8 == ARA-2 Hardware and Setup
    9 
    10 
    11 
    12 Download the Kinara Ara-2 SDK Release 1.3 (Licensed) from [https://support.kinara.ai/SDK ] by clicking the 3 dots under the action column (download SDK) onto your host and extract it.
    13 
    14 
    15 It should create a folder named 'art'
    16 
    17 Instructions are in the README_linux_aarch64.txt file inside the extracted folder. Also, the main instructions to follow are on the Kinara support site at [https://support.kinara.ai/api//assets/sdk/1.3/public/sdk/Ara2-quickstart.html]
    18 
    19 
    20 Copy the 'art' folder from the ARA-2 SDK to the Gateworks SBC with something like scp. (adjust IP, path, etc as needed)
    21 {{{
    22 scp -r user@192.168.1.1:/kinara/art ./
    23 }}}
    24 
    25 Verify the Kinara card is detected on the PCIe bus:
    26 {{{
    27 root@noble-venice:~/art/linux/aarch64/hw_utils# lspci
    28 81:00.0 Processing accelerators: Device 1e58:0002 (rev 02)
    29 }}}
    30 
    31 Build the uiodma kernel module on the Gateworks Single Board Computer (using 6.12 kernel)
    32 {{{
    33 apt-get update
    34 apt-get install build-essential
    35 cd art/linux/drivers/uiodma/
    36 make clean
    37 make
    38 }}}
    39 
    40 Insert the compiled uiodma module:
    41 {{{
    42 insmod art/linux/drivers/uiodma/uiodma.ko 
    43 sudo echo "1e58 0002" > /sys/bus/pci/drivers/uiodma/new_id
    44 
    45 }}}
    46 
    47 Verify the uiodma driver is being attached to the hardware with the command:
    48 {{{
    49 root@noble-venice:~/demos# lspci -k
    50 01:00.0 Processing accelerators: Device 1e58:0002 (rev 02)
    51         Subsystem: Device 0020:0020
    52         Kernel driver in use: uiodma
    53 }}}
    54 
    55 Get Chip info:
    56 {{{
    57 root@noble-venice:~/art/linux# ./aarch64/hw_utils/bins/chip_info_aarch64 -e 0
    58 Kinara Inc. Silicon utilities version 0.5.9
    59 
    60 Run directory: /root/art/linux
    61 ./aarch64/hw_utils/bins/chip_info_aarch64 -e 0
    62 
    63 [I:20260123:00:02:36:178031] [] [kinara_main_635][IODeviceManager] enumerate ara2 pci devices
    64 [I:20260123:00:02:36:405024] [] [kinara_main_635][IODeviceManager] path= /sys/devices/platform/soc@0/33800000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:03.0/0000:81:00.0/
    65 [I:20260123:00:02:36:405187] [] [kinara_main_635][IODeviceManager] instance name: IODeviceManager, found an ara2 pci device at: /sys/devices/platform/soc@0/33800000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:03.0/0000:81:00.0/
    66 [I:20260123:00:02:36:405372] [] [kinara_main_635][pci_io_00:81.0] cache management 0
    67 [I:20260123:00:02:36:405398] [] [kinara_main_635][pci_io_00:81.0] instance name: Ara2PcieIO_0, ara2 pci device folder path: /sys/devices/platform/soc@0/33800000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/0000:02:03.0/0000:81:00.0/
    68 [I:20260123:00:02:36:405521] [] [kinara_main_635][pci_io_00:81.0] instance name: Ara2PcieIO_0, phy0=0x18700000 phy1=0x18500000 phy2=0x18600000
    69 [I:20260123:00:02:36:411041] [] [kinara_main_635][pci_io_00:81.0] enabling pcie_ste_dma for device
    70 [W:20260123:00:02:36:411150] [] [kinara_main_635][pci_io_00:81.0] instance name: Ara2PcieIO_0, uiodma addr is : 0x7b000000
    71 [I:20260123:00:02:36:411293] [] [kinara_main_635][pci_io_00:81.0] successfully enabled pcie_ste_dma for pcie device
    72 [I:20260123:00:02:36:421550] [] [kinara_main_635][pci_io_00:81.0] instance name: Ara2PcieIO_0, vendor=0x1e58 product=0x2
    73 [I:20260123:00:02:36:422136] [] [kinara_main_635][pci_io_00:81.0] Calling pcie tl clock programming, removing pcie clock from bypass
    74 [W:20260123:00:02:36:425541] [ChipInfo] [kinara_main_635][ChipInfo] ara_physical_id:  0
    75 [I:20260123:00:02:36:426262] [] [task_request_queue_processing_task_runner0_640][ChipInfoRequest] BOOT SUCCESS
    76 [I:20260123:00:02:36:426304] [] [task_request_queue_processing_task_runner0_640][ChipInfoRequest] HIF IS ENABLED
    77 [I:20260123:00:02:36:527551] [ChipInfo] [kinara_main_635][ChipInfo] Request Done
    78 [I:20260123:00:02:36:532629] [ChipInfo] [kinara_main_635][ChipInfo] chip info for the devices connected
    79  +-----------+---------------+----------------------------------------------+
    80 | Tool      | Device Number | Info                                         |
    81 +-----------+---------------+----------------------------------------------+
    82 | Chip Info | 0, strap:0    | +-----------------------------+------------+ |
    83 |           |               | | Parameter                   | Value      | |
    84 |           |               | +-----------------------------+------------+ |
    85 |           |               | | chip_id                     | Ara2 A01   | |
    86 |           |               | | bus_id                      | 0:129:0    | |
    87 |           |               | | if_type                     | PCIE       | |
    88 |           |               | | chip_physical_id            | 0          | |
    89 |           |               | | pcie_present                | 1          | |
    90 |           |               | | usb_present                 | 0          | |
    91 |           |               | | ddr_present                 | 1          | |
    92 |           |               | | jtag_present                |            | |
    93 |           |               | | sys_frequency               | 25 MHz     | |
    94 |           |               | | neural_processor_frequency  | 25 MHz     | |
    95 |           |               | | control_processor_frequency | 25 MHz     | |
    96 |           |               | | ddr_frequency               | 25 MHz     | |
    97 |           |               | | ddr_mfr                     |            | |
    98 |           |               | | ddr_size                    | NA         | |
    99 |           |               | | flash_mfr                   | NA         | |
    100 |           |               | | flash_size                  | NA         | |
    101 |           |               | | num_flash_images            | NA         | |
    102 |           |               | | dev_temp1                   | 21.07 C    | |
    103 |           |               | | voltage1                    | 0.788796 V | |
    104 |           |               | | last power state            | NA         | |
    105 |           |               | | current power state         | L1         | |
    106 |           |               | | boot_status                 | 1          | |
    107 |           |               | | internal_mem_size           | 8 MB       | |
    108 |           |               | | life_cycle                  | TESTED     | |
    109 |           |               | | firmware_version(raw)       | 32779      | |
    110 |           |               | | firmware_version            | 0.128.11   | |
    111 |           |               | +-----------------------------+------------+ |
    112 |           |               |                                              |
    113 +-----------+---------------+----------------------------------------------+
    114 
    115 root@noble-venice:~/art/linux#
    116 
    117 }}}
    118 
    119 Program the Flash (one time only):
    120 {{{
    121 ./bins/program_flash_aarch64 -e 0 -f ./boot_img/willow_therm.hex
    122 <reboot the host/ reset ara device to get new firmware loaded on ara device>
    123 }}}
    124 
    125 
    126 Activate the chip:
    127 {{{
    128 root@noble-venice:~/art/linux/aarch64/hw_utils# ./bins/active_enable_aarch64 -e 0 -m 2
    129 Kinara Inc. Silicon utilities version 0.5.9
    130 
    131 Run directory: /root/art/linux/aarch64/hw_utils
    132 ./bins/active_enable_aarch64 -e 0 -m 2
    133 
    134 [I:20260129:17:16:09:595108] [] [kinara_main_678][Active_Enable] In run phase of Flash image
    135 [I:20260129:17:16:09:595458] [] [kinara_main_678][Active_Enable] Device Found Done ara-physical-id= 0
    136 [I:20260129:17:16:09:595487] [] [kinara_main_678][IODeviceManager] enumerate ara2 pci devices
    137 [I:20260129:17:16:09:794621] [] [kinara_main_678][IODeviceManager] path= /sys/devices/platform/soc@0/33800000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/
    138 [I:20260129:17:16:09:794732] [] [kinara_main_678][IODeviceManager] instance name: IODeviceManager, found an ara2 pci device at: /sys/devices/platform/soc@0/33800000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/
    139 [I:20260129:17:16:09:794880] [] [kinara_main_678][pci_io_00:01.0] cache management 0
    140 [I:20260129:17:16:09:794901] [] [kinara_main_678][pci_io_00:01.0] instance name: Ara2PcieIO_0, ara2 pci device folder path: /sys/devices/platform/soc@0/33800000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/
    141 [I:20260129:17:16:09:795008] [] [kinara_main_678][pci_io_00:01.0] instance name: Ara2PcieIO_0, phy0=0x18300000 phy1=0x18100000 phy2=0x18200000
    142 [I:20260129:17:16:09:798594] [] [kinara_main_678][pci_io_00:01.0] enabling pcie_ste_dma for device
    143 [W:20260129:17:16:09:798675] [] [kinara_main_678][pci_io_00:01.0] instance name: Ara2PcieIO_0, uiodma addr is : 0xf0a00000
    144 [I:20260129:17:16:09:798777] [] [kinara_main_678][pci_io_00:01.0] successfully enabled pcie_ste_dma for pcie device
    145 [I:20260129:17:16:09:805173] [] [kinara_main_678][pci_io_00:01.0] instance name: Ara2PcieIO_0, vendor=0x1e58 product=0x2
    146 [I:20260129:17:16:09:807783] [] [kinara_main_678][pci_io_00:01.0] Calling pcie tl clock programming, removing pcie clock from bypass
    147 [I:20260129:17:16:09:808154] [] [kinara_main_678][Active_Enable] [CTEST]: SBP Ready for Runtime Command
    148 
    149 [I:20260129:17:16:09:808182] [] [kinara_main_678][Active_Enable] [CTEST]: HIF is SETUP
    150 [I:20260129:17:16:09:808197] [] [kinara_main_678][Active_Enable] Entering State Full PRD 2
    151 [I:20260129:17:16:09:808214] [] [kinara_main_678][Active_Enable] {} 4
    152 [I:20260129:17:16:09:808251] [] [kinara_main_678][Active_Enable] [CTEST]: Pushed HIF req Type :   211 1 1
    153 [I:20260129:17:16:09:808265] [] [kinara_main_678][Active_Enable] [CTEST]: Pushed HIF req occ :  32
    154 [I:20260129:17:16:09:808629] [] [kinara_main_678][Active_Enable] {} 4
    155 [I:20260129:17:16:09:808673] [] [kinara_main_678][Active_Enable] [CTEST]: HIF response 0
    156 [I:20260129:17:16:09:808693] [] [kinara_main_678][Active_Enable] [CTEST]: CMD_TYPE   211
    157 [I:20260129:17:16:09:808711] [] [kinara_main_678][Active_Enable] [CTEST]: CMD_ID     1
    158 [I:20260129:17:16:09:808728] [] [kinara_main_678][Active_Enable] [CTEST]: QID_ID     1
    159 [I:20260129:17:16:09:808746] [] [kinara_main_678][Active_Enable] [CTEST]: HIF PS Read Response
    160 [I:20260129:17:16:09:808765] [] [kinara_main_678][Active_Enable] [CTEST]: Status :   0
    161 [I:20260129:17:16:09:808782] [] [kinara_main_678][Active_Enable] [CTEST]: PS Response Data Status :   0
    162 [I:20260129:17:16:09:808799] [] [kinara_main_678][Active_Enable] [CTEST]: PS Response Data Current Power State :   2
    163 [I:20260129:17:16:09:808816] [] [kinara_main_678][Active_Enable] [CTEST]: PS Response Data PVT_LOCK :  0
    164 [I:20260129:17:16:09:808836] [] [kinara_main_678][Active_Enable] [CTEST]: TEST PASSED
    165 }}}
    166 
    167 Configure the DRAM:
    168 {{{
    169 root@noble-venice:~/art/linux/aarch64/hw_utils# ./bins/ddr_unified_config_aarch64 -e 0 -s 1 -g 1 -l 3 -w 2 -f 0 -n 0 -u 0 -m 0 -r 0 -b willow -o ./ddr_config/ddr_cfg_35.bin
    170 Kinara Inc. Silicon utilities version 0.5.9
    171 
    172 Run directory: /root/art/linux/aarch64/hw_utils
    173 ./bins/ddr_unified_config_aarch64 -e 0 -s 1 -g 1 -l 3 -w 2 -f 0 -n 0 -u 0 -m 0 -r 0 -b willow -o ./ddr_config/ddr_cfg_35.bin
    174 
    175 [I:20260129:17:17:05:155740] [] [kinara_main_706][IODeviceManager] enumerate ara2 pci devices
    176 [I:20260129:17:17:05:343281] [] [kinara_main_706][IODeviceManager] path= /sys/devices/platform/soc@0/33800000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/
    177 [I:20260129:17:17:05:343392] [] [kinara_main_706][IODeviceManager] instance name: IODeviceManager, found an ara2 pci device at: /sys/devices/platform/soc@0/33800000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/
    178 [I:20260129:17:17:05:343538] [] [kinara_main_706][pci_io_00:01.0] cache management 0
    179 [I:20260129:17:17:05:343558] [] [kinara_main_706][pci_io_00:01.0] instance name: Ara2PcieIO_0, ara2 pci device folder path: /sys/devices/platform/soc@0/33800000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/
    180 [I:20260129:17:17:05:343663] [] [kinara_main_706][pci_io_00:01.0] instance name: Ara2PcieIO_0, phy0=0x18300000 phy1=0x18100000 phy2=0x18200000
    181 [I:20260129:17:17:05:346269] [] [kinara_main_706][pci_io_00:01.0] enabling pcie_ste_dma for device
    182 [W:20260129:17:17:05:346327] [] [kinara_main_706][pci_io_00:01.0] instance name: Ara2PcieIO_0, uiodma addr is : 0xf0a00000
    183 [I:20260129:17:17:05:346428] [] [kinara_main_706][pci_io_00:01.0] successfully enabled pcie_ste_dma for pcie device
    184 [I:20260129:17:17:05:351159] [] [kinara_main_706][pci_io_00:01.0] instance name: Ara2PcieIO_0, vendor=0x1e58 product=0x2
    185 [I:20260129:17:17:05:353537] [] [kinara_main_706][pci_io_00:01.0] Calling pcie tl clock programming, removing pcie clock from bypass
    186 [I:20260129:17:17:05:353868] [] [kinara_main_706][ddr_unified_config] Configuring DDR now. Approxmiate time to complete: 60 seconds.
    187 [I:20260129:17:17:05:353894] [] [kinara_main_706][ddr_unified_config] UNIFIED CFG BIN LOADING
    188 [I:20260129:17:17:36:009795] [] [kinara_main_706][ddr_unified_config] DDR configuation successful. DDR BIST: PASSED
    189 }}}
    190 
    191 
    192 Activate Proxy: (change config/proxy_config.yaml if you want to run in background)
    193 
    194 {{{
    195 root@noble-venice:~/art/linux/aarch64/proxy# sudo ./proxy_aarch64 -c ../../config/proxy_config.yaml
    196 
    197 Kinara Inc. Silicon utilities version 0.5.9
    198 
    199 Run directory: /root/art/linux/aarch64/proxy
    200 ./proxy_aarch64 -c ../../config/proxy_config.yaml
    201 
    202 [I:20260129:17:23:04:425472] [] [kinara_main_764][GlobalLogger]
    203 root@noble-venice:~/art/linux/aarch64/proxy# ps -aef | grep prox
    204 root         766       1  9 17:23 ?        00:00:00 ./proxy_aarch64 -c ../../config/proxy_config.yaml
    205 }}}
    206 
    207 Download a sample yolov8n model (.dvm file) and untar:
    208  * Download [https://workdrive.zohoexternal.com/external/8c92f49dc6ba6e433a99801eef80363a46c7c8b74c9907bd47b0f3c4b9eccf14 URL] (may require access to support.kinara.ai portal)
    209  * Transfer to Gateworks SBC and untar (adjust IP to machine where file is hosted):
    210 {{{
    211 root@noble-venice:~/art/linux/aarch64/nnapp# wget 192.168.1.1/kinara/sdk_model_compile.tar.gz
    212 --2026-01-29 17:26:52--  http://192.168.1.1/kinara/sdk_model_compile.tar.gz
    213 Connecting to 192.168.1.1:80... connected.
    214 HTTP request sent, awaiting response... 200 OK
    215 Length: 23754978 (23M) [application/x-gtar-compressed]
    216 Saving to: ‘sdk_model_compile.tar.gz’
    217 
    218 sdk_model_compile.tar.gz                        100%[=====================================================================================================>]  22.65M   112MB/s    in 0.2s   
    219 
    220 2026-01-29 17:26:52 (112 MB/s) - ‘sdk_model_compile.tar.gz’ saved [23754978/23754978]
    221 root@noble-venice:~/art/linux/aarch64/nnapp# tar -xvf sdk_model_compile.tar.gz
    222 }}}
    223 
    224 Either change the input path to the model, or move the model to /tmp
    225 
    226 Modify the ../../config/nnapp_config.yaml and change the input_path in the async section:
    227 {{{
    228 async:
    229         # if this flag is TRUE, then the input directory of each model is iterated only once.
    230         # else, the input directory is iterated for model_param.batch_size * model_param.iterations times
    231         run_once_and_for_all: False
    232         utilization_stats: False
    233         # dump outputs with timestamp
    234         dump_with_timestamp: False
    235         # this section contains all the model related params for infer async mode
    236         models:
    237           0:
    238             name: "model1"
    239             path: "/tmp/model.dvm"
    240             input_path: ""
    241             output_path: ""
    242 
    243 }}}
    244 
    245 Execute the sample model run:
    246 {{{
    247 root@noble-venice:~/art/linux/aarch64/nnapp# ./nnapp_aarch64 --config ../../config/nnapp_config.yaml
    248 [W:20260129:17:29:41:832406] [] [n/a_-1][config] default YAML file not found  ./config.yaml , specify yaml path
    249 Kinara, Inc.
    250 
    251 *---------------------------------------------------------------*
    252 *              Neural Network Inference Application             *
    253 *    Copyright(c) 2018-23, Kinara, Inc. All rights reserved.    *
    254 *---------------------------------------------------------------*
    255 
    256 Run:
    257 working directory: /root/art/linux/aarch64/nnapp
    258 ./nnapp_aarch64 --config ../../config/nnapp_config.yaml
    259 the app expects the inputs as raw tensors. The inputs are assumed to be preprocessed and written to a file
    260 the inputs have to be in the below format:
    261 <input_image_name>/quantized/layer<layer_id>-<blob_name>-<blob_id>_input_dv.dat
    262 and the golden inputs in the below format:
    263 <input_image_name>/quantized/<layer_name>-<layer_id>-<blob_name>-<blob_id>
    264 [I:20260129:17:29:41:898866] [] [main_807][model_parameters] empty input_path for model= model1 , setting output_path and golden_output_path to none
    265 [I:20260129:17:29:41:903483] [] [main_807][BaseApp] connected to proxy socket: IP_Address= 127.0.0.1  port= 5000
    266 [I:20260129:17:29:41:904161] [] [main_807][BaseApp]
    267  +------------+-----------------+
    268 | Product    | Current Version |
    269 +------------+-----------------+
    270 | client_lib | 1.3.0.0         |
    271 | firmware   | 0.128.11.0      |
    272 | proxy      | 1.3.0.0         |
    273 | sysapi     | 1.1.61.0        |
    274 +------------+-----------------+
    275 
    276 [I:20260129:17:29:41:904950] [] [main_807][BaseApp]
    277  +------------+--------------------+
    278 | Product    | Supported Versions |
    279 +------------+--------------------+
    280 | client_lib | 1.0.0.0            |
    281 | client_lib | 1.1.1.0            |
    282 | client_lib | 1.1.2.0            |
    283 | client_lib | 1.3.0.0            |
    284 | cnn_model  | 2.0.0.0            |
    285 | cnn_model  | 2.1.0.0            |
    286 | firmware   | 0.5.2.0            |
    287 | firmware   | 1.1.2.0            |
    288 | llm_model  | 3.0.0.0            |
    289 | llm_model  | 3.1.0.0            |
    290 | pci_driver | 1.0.4.0            |
    291 | pci_driver | 1.0.6.6            |
    292 | proxy      | 0.8.0.0            |
    293 | proxy      | 0.9.0.0            |
    294 | proxy      | 1.1.1.0            |
    295 | proxy      | 1.3.0.0            |
    296 +------------+--------------------+
    297 
    298 [I:20260129:17:29:41:905463] [] [main_807][BaseApp] found endpoints: count= 1
    299 [I:20260129:17:29:41:905908] [] [main_807][BaseApp] creation of endpoint group successful: model= model1
    300 [I:20260129:17:29:41:984637] [] [main_807][BaseApp] model load successful: model= model1
    301 [I:20260129:17:29:42:011215] [] [task_print_device_stats_812][Stats] temperature= 36.2557 ep status:  DV_ENDPOINT_STATE_ACTIVE  0x1000608c:   15d0200
    302 [I:20260129:17:29:42:072253] [] [main_807][AsyncApp] completed iteration= 1
    303 [I:20260129:17:29:42:145357] [] [main_807][AsyncApp] completed iteration= 2
    304 [I:20260129:17:29:42:218729] [] [main_807][AsyncApp] completed iteration= 3
    305 [I:20260129:17:29:42:291966] [] [main_807][AsyncApp] completed iteration= 4
    306 [I:20260129:17:29:42:365203] [] [main_807][AsyncApp] completed iteration= 5
    307 [I:20260129:17:29:42:437872] [] [main_807][AsyncApp] completed iteration= 6
    308 [I:20260129:17:29:42:510537] [] [main_807][AsyncApp] completed iteration= 7
    309 [I:20260129:17:29:42:584005] [] [main_807][AsyncApp] completed iteration= 8
    310 [I:20260129:17:29:42:656563] [] [main_807][AsyncApp] completed iteration= 9
    311 [I:20260129:17:29:42:729354] [] [main_807][AsyncApp] completed iteration= 10
    312 [I:20260129:17:29:42:802121] [] [main_807][AsyncApp] completed iteration= 11
    313 [I:20260129:17:29:42:874931] [] [main_807][AsyncApp] completed iteration= 12
    314 [I:20260129:17:29:42:947354] [] [main_807][AsyncApp] completed iteration= 13
    315 [I:20260129:17:29:43:012893] [] [task_print_device_stats_812][Stats] temperature= 36.2557 ep status:  DV_ENDPOINT_STATE_ACTIVE  0x1000608c:   15d0200
    316 [I:20260129:17:29:43:020108] [] [main_807][AsyncApp] completed iteration= 14
    317 [I:20260129:17:29:43:094043] [] [main_807][AsyncApp] completed iteration= 15
    318 [I:20260129:17:29:43:166269] [] [main_807][AsyncApp] completed iteration= 16
    319 [I:20260129:17:29:43:238760] [] [main_807][AsyncApp] completed iteration= 17
    320 [I:20260129:17:29:43:311065] [] [main_807][AsyncApp] completed iteration= 18
    321 [I:20260129:17:29:43:383388] [] [main_807][AsyncApp] completed iteration= 19
    322 [I:20260129:17:29:43:455880] [] [main_807][AsyncApp] completed iteration= 20
    323 [I:20260129:17:29:43:456773] [] [main_807][Stats] summary stats
    324  ╔════════╤════════════════════════════╤═════════════════════════╤═══════════════════════════╤══════════════════╗
    325 ║ Model  │        hw_time (ms)        │      ip_time (ms)       │       op_time (ms)        │  app_time (ms)   ║
    326 ╠════════╪════════╤═════════╤═════════╪═══════╤═══════╤═════════╪════════╤════════╤═════════╪═════╤═════╤══════╣
    327 ║        │ max    │ min     │ mean    │ max   │ min   │ mean    │ max    │ min    │ mean    │ max │ min │ mean ║
    328 ╟────────┼────────┼─────────┼─────────┼───────┼───────┼─────────┼────────┼────────┼─────────┼─────┼─────┼──────╢
    329 ║ model1 │ 3.1052 │ 3.08395 │ 3.09515 │ 4.365 │ 2.346 │ 3.17945 │ 12.187 │ 10.369 │ 11.3023 │ 76  │ 71  │ 71.9 ║
    330 ╚════════╧════════╧═════════╧═════════╧═══════╧═══════╧═════════╧════════╧════════╧═════════╧═════╧═════╧══════╝
    331  
    332   model_name=model1 iteration=20 batch_size=5 num_ip=1 num_op=1 total_ip_size=122880000 total_op_size=120960000 num_inferences=100
    333 
    334 [I:20260129:17:29:43:457176] [] [main_807][Stats] endpoint load distribution:  [0,100]
    335 [I:20260129:17:29:43:457195] [] [main_807][Stats] total number of inferences:  100
    336 [I:20260129:17:29:43:457221] [] [main_807][Stats] Performance: HW IPS= 323.086  App IPS= 69.541
    337 root@noble-venice:~/art/linux/aarch64/nnapp#
    338 }}}
    339 
    340 Note the final line that shows Performance: HW IPS= 323.086.
    341 
    342 == Modelzoo Demo
    343 
    344 Gain access from Kinara to https://github.com/KinaraAi/kinara-modelzoo-ara2
    345 
    346 Scroll down for all the instructions on that page.
    347 
    348 The key instructions are:
    349 
    350 {{{
    351 git clone https://github.com/KinaraAi/kinara-modelzoo-ara2.git
    352 pip3 install -r requirements.txt
    353 
    354 }}}
    355 
    356 
    357 Set runtime:
    358 {{{
    359 export DV_TGT_ROOT=<Path-to-runtime>
    360 }}}
    361 
    362 Download pre-compiled models:
    363 {{{
    364 cd kinara-modelzoo-ara2/flows
    365 ./precompiled_model_download.sh model=mobilenetv1-tf
    366 }}}
    367 
    368 
    369 Run an inference:
    370 {{{
    371 ./infer-hw.sh images_folder=../testimages model=mobilenetv1-tf
    372 }}}
    373 
    374 
    375 
    376 
     1close page, move to [wiki:expansion/gw16168]