Changes between Version 6 and Version 7 of venice/npu

Timestamp:

08/09/2024 07:23:20 PM (4 months ago)

Author:

Blake Stewart

Comment:

NXP Feedback with old images

venice/npu

@@ -177 +177 @@
 }}}
 
-Without the NPU: {{{Inference time: 170.5 ms}}}
-With the NPU: {{{Inference time: 3.2 ms}}}
-
-Without considering the warmup times, this is a >**98% speedup**! For every CPU frame, the NPU can process 53.
+Without the NPU: {{{Image Classification time: 170.5 ms}}}
+With the NPU: {{{Image Classification: 3.2 ms}}}
+
+Without considering the warmup times, this is a >**98% speedup**! For every CPU frame, the NPU can process 53. 
+
+This data is derived from {{{classifications/sec = 1/(image classification time)}}} 
 
 [[Image(https://trac.gateworks.com/raw-attachment/wiki/venice/npu/gw74xx_npu_benchmark.png)]]
 
-=== GStreamer Example
+=== GStreamer Example for Detection
 
 Section 8.2 of the Machine Learning Users Guide details this process, such as how to download the necessary models. After following the download steps, the {{{home/root/nxp-nnstreamer-examples/}}} directory on your board should have a {{{downloads}}} directory with {{{models}}} and {{{media}}} directories. If not, you need to run the update script on your host to compile the models and scp them to the board.
@@ -198 +200 @@
 }}}
 
-If everything works properly, you should instantly see your video input streamed to your desktop host. After a few seconds of warming up, the bounding boxes from the [[https://nnstreamer.github.io/gst/nnstreamer/README.html | TensorFlow filter]] will be overlaid on the video. The stream properties can be changed for different resolutions and framerates; see [[https://trac.gateworks.com/wiki/Yocto/gstreamer/streaming | gstreamer/streaming]].
+If everything works properly, you should instantly see your video input streamed to your desktop host. After a few seconds of warming up, the bounding boxes from the [[https://nnstreamer.github.io/gst/nnstreamer/README.html | TensorFlow Detection filter]] will be overlaid on the video. The stream properties can be changed for different resolutions and framerates; see [[https://trac.gateworks.com/wiki/Yocto/gstreamer/streaming | gstreamer/streaming]]. NOTE: This example is object detection, which differs from the image classification that we got benchmark data from in the previous section.
 
 [[Image(https://trac.gateworks.com/raw-attachment/wiki/venice/npu/imx8mp_border.png)]]