Changes between Version 6 and Version 7 of venice/npu


Ignore:
Timestamp:
08/09/2024 07:23:20 PM (6 weeks ago)
Author:
Blake Stewart
Comment:

NXP Feedback with old images

Legend:

Unmodified
Added
Removed
Modified
  • venice/npu

    v6 v7  
    177177}}}
    178178
    179 Without the NPU: {{{Inference time: 170.5 ms}}}
    180 With the NPU: {{{Inference time: 3.2 ms}}}
    181 
    182 Without considering the warmup times, this is a >**98% speedup**! For every CPU frame, the NPU can process 53.
     179Without the NPU: {{{Image Classification time: 170.5 ms}}}
     180With the NPU: {{{Image Classification: 3.2 ms}}}
     181
     182Without considering the warmup times, this is a >**98% speedup**! For every CPU frame, the NPU can process 53.
     183
     184This data is derived from {{{classifications/sec = 1/(image classification time)}}}
    183185
    184186[[Image(https://trac.gateworks.com/raw-attachment/wiki/venice/npu/gw74xx_npu_benchmark.png)]]
    185187
    186 === GStreamer Example
     188=== GStreamer Example for Detection
    187189
    188190Section 8.2 of the Machine Learning Users Guide details this process, such as how to download the necessary models. After following the download steps, the {{{home/root/nxp-nnstreamer-examples/}}} directory on your board should have a {{{downloads}}} directory with {{{models}}} and {{{media}}} directories. If not, you need to run the update script on your host to compile the models and scp them to the board.
     
    198200}}}
    199201
    200 If everything works properly, you should instantly see your video input streamed to your desktop host. After a few seconds of warming up, the bounding boxes from the [[https://nnstreamer.github.io/gst/nnstreamer/README.html | TensorFlow filter]] will be overlaid on the video. The stream properties can be changed for different resolutions and framerates; see [[https://trac.gateworks.com/wiki/Yocto/gstreamer/streaming | gstreamer/streaming]].
     202If everything works properly, you should instantly see your video input streamed to your desktop host. After a few seconds of warming up, the bounding boxes from the [[https://nnstreamer.github.io/gst/nnstreamer/README.html | TensorFlow Detection filter]] will be overlaid on the video. The stream properties can be changed for different resolutions and framerates; see [[https://trac.gateworks.com/wiki/Yocto/gstreamer/streaming | gstreamer/streaming]]. NOTE: This example is object detection, which differs from the image classification that we got benchmark data from in the previous section.
    201203
    202204[[Image(https://trac.gateworks.com/raw-attachment/wiki/venice/npu/imx8mp_border.png)]]