Changes between Version 4 and Version 5 of hailoai


Ignore:
Timestamp:
03/20/2024 11:19:53 PM (8 weeks ago)
Author:
Ryan Erbstoesser
Comment:

add more info

Legend:

Unmodified
Added
Removed
Modified
  • hailoai

    v4 v5  
    1 = Hailo AI
     1[[PageOutline]]
     2= Hailo AI - Edge AI Processors 
     3[[Image(hailo_hailo8_m2.jpg)]]
    24
    35Hailo is a hardware manufacturer that produces high-performance, low-power AI accelerators and vision processors uniquely designed to accelerate embedded deep learning applications on edge devices.
     
    1113
    1214
    13 [[Image(hailo_hailo8_m2.jpg,300px)]]
     15
    1416
    1517
    1618= Quick Start Guide
    1719
    18 Required Equipment:
     20'''Required Equipment:'''
    1921 * Gateworks Venice SBC with latest software (testing was done with Ubuntu Jammy and 6.6.8 kernel)
    2022 * Hailo AI Hailo-8 M.2 module [https://hailo.ai/products/ai-accelerators/hailo-8-m2-ai-acceleration-module/ here]
    2123 * Gateworks GW16148 Mini-PCIe to M.2 M-Key adapter
    2224 * Hailo AI Developer Account (free) [https://hailo.ai/developer-zone/]
     25
     26'''Steps:'''
    2327
    24281. Download Hailo AI Software for Gateworks SBC
     
    8589root@jammy-venice:~#
    8690}}}
    87 1.
    88 Verify Hailo PCIe device is seen with the hailo rt cli software tool:
     911. Verify Hailo PCIe device is seen with the hailo rt cli software tool:
    8992{{{
    9093root@jammy-venice:~# hailortcli scan
     
    100103 * Note HEF files can be downloaded here:
    101104  * [https://github.com/hailo-ai/hailo_model_zoo/blob/master/docs/PUBLIC_MODELS.rst]
    102 {{{
    103 root@jammy-venice:~# hailortcli run my.hef
    104 }}}
    105 
    106 Venice Performance Test:
     105
     106{{{
     107root@jammy-venice:~# wget https://hailo-model-zoo.s3.eu-west-2.amazonaws.com/ModelZoo/Compiled/v2.10.0/hailo8/efficientnet_l.hef
     108--2024-03-20 23:18:31--  https://hailo-model-zoo.s3.eu-west-2.amazonaws.com/ModelZoo/Compiled/v2.10.0/hailo8/efficientnet_l.hef
     109Resolving hailo-model-zoo.s3.eu-west-2.amazonaws.com (hailo-model-zoo.s3.eu-west-2.amazonaws.com)... 52.95.191.58, 52.95.144.10, 52.95.148.10, ...
     110Connecting to hailo-model-zoo.s3.eu-west-2.amazonaws.com (hailo-model-zoo.s3.eu-west-2.amazonaws.com)|52.95.191.58|:443... connected.
     111HTTP request sent, awaiting response... 200 OK
     112Length: 11815410 (11M) [binary/octet-stream]
     113Saving to: ‘efficientnet_l.hef’
     114
     115efficientnet_l.hef                 100%[==============================================================>]  11.27M  5.68MB/s    in 2.0s   
     116
     1172024-03-20 23:18:34 (5.68 MB/s) - ‘efficientnet_l.hef’ saved [11815410/11815410]
     118}}}
     119
     120{{{   
     121root@jammy-venice:~# hailortcli run efficientnet_l.hef
     122Running streaming inference (efficientnet_l.hef):
     123  Transform data: true
     124    Type:      auto
     125    Quantized: true
     126Network efficientnet_l/efficientnet_l: 100% | 774 | FPS: 154.57 | ETA: 00:00:00
     127> Inference result:
     128 Network group: efficientnet_l
     129    Frames count: 774
     130    FPS: 154.58
     131    Send Rate: 333.89 Mbit/s
     132    Recv Rate: 1.25 Mbit/s
     133
     134root@jammy-venice:~#
     135}}}
     136
     137Venice Performance Test: (requires Hailo Integration tool, SW package from Hailo SW Developer Zone downloads)
    107138{{{
    108139root@jammy-venice:~# hailo-integration-tool -g test.json #generate test.json file which tells which tests to run, edit the file to set tests to true and false, etc