Changes between Version 4 and Version 5 of hailoai
- Timestamp:
- 03/20/2024 11:19:53 PM (8 months ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
hailoai
v4 v5 1 = Hailo AI 1 [[PageOutline]] 2 = Hailo AI - Edge AI Processors 3 [[Image(hailo_hailo8_m2.jpg)]] 2 4 3 5 Hailo is a hardware manufacturer that produces high-performance, low-power AI accelerators and vision processors uniquely designed to accelerate embedded deep learning applications on edge devices. … … 11 13 12 14 13 [[Image(hailo_hailo8_m2.jpg,300px)]] 15 14 16 15 17 16 18 = Quick Start Guide 17 19 18 Required Equipment: 20 '''Required Equipment:''' 19 21 * Gateworks Venice SBC with latest software (testing was done with Ubuntu Jammy and 6.6.8 kernel) 20 22 * Hailo AI Hailo-8 M.2 module [https://hailo.ai/products/ai-accelerators/hailo-8-m2-ai-acceleration-module/ here] 21 23 * Gateworks GW16148 Mini-PCIe to M.2 M-Key adapter 22 24 * Hailo AI Developer Account (free) [https://hailo.ai/developer-zone/] 25 26 '''Steps:''' 23 27 24 28 1. Download Hailo AI Software for Gateworks SBC … … 85 89 root@jammy-venice:~# 86 90 }}} 87 1. 88 Verify Hailo PCIe device is seen with the hailo rt cli software tool: 91 1. Verify Hailo PCIe device is seen with the hailo rt cli software tool: 89 92 {{{ 90 93 root@jammy-venice:~# hailortcli scan … … 100 103 * Note HEF files can be downloaded here: 101 104 * [https://github.com/hailo-ai/hailo_model_zoo/blob/master/docs/PUBLIC_MODELS.rst] 102 {{{ 103 root@jammy-venice:~# hailortcli run my.hef 104 }}} 105 106 Venice Performance Test: 105 106 {{{ 107 root@jammy-venice:~# wget https://hailo-model-zoo.s3.eu-west-2.amazonaws.com/ModelZoo/Compiled/v2.10.0/hailo8/efficientnet_l.hef 108 --2024-03-20 23:18:31-- https://hailo-model-zoo.s3.eu-west-2.amazonaws.com/ModelZoo/Compiled/v2.10.0/hailo8/efficientnet_l.hef 109 Resolving hailo-model-zoo.s3.eu-west-2.amazonaws.com (hailo-model-zoo.s3.eu-west-2.amazonaws.com)... 52.95.191.58, 52.95.144.10, 52.95.148.10, ... 110 Connecting to hailo-model-zoo.s3.eu-west-2.amazonaws.com (hailo-model-zoo.s3.eu-west-2.amazonaws.com)|52.95.191.58|:443... connected. 111 HTTP request sent, awaiting response... 200 OK 112 Length: 11815410 (11M) [binary/octet-stream] 113 Saving to: ‘efficientnet_l.hef’ 114 115 efficientnet_l.hef 100%[==============================================================>] 11.27M 5.68MB/s in 2.0s 116 117 2024-03-20 23:18:34 (5.68 MB/s) - ‘efficientnet_l.hef’ saved [11815410/11815410] 118 }}} 119 120 {{{ 121 root@jammy-venice:~# hailortcli run efficientnet_l.hef 122 Running streaming inference (efficientnet_l.hef): 123 Transform data: true 124 Type: auto 125 Quantized: true 126 Network efficientnet_l/efficientnet_l: 100% | 774 | FPS: 154.57 | ETA: 00:00:00 127 > Inference result: 128 Network group: efficientnet_l 129 Frames count: 774 130 FPS: 154.58 131 Send Rate: 333.89 Mbit/s 132 Recv Rate: 1.25 Mbit/s 133 134 root@jammy-venice:~# 135 }}} 136 137 Venice Performance Test: (requires Hailo Integration tool, SW package from Hailo SW Developer Zone downloads) 107 138 {{{ 108 139 root@jammy-venice:~# hailo-integration-tool -g test.json #generate test.json file which tells which tests to run, edit the file to set tests to true and false, etc