Changes between Version 7 and Version 8 of ventana/vpu

Timestamp:

01/22/2019 08:24:56 PM (5 years ago)

Author:

Tim Harvey

Comment:

added more details about VPU/coda requirements

ventana/vpu

@@ -8 +8 @@
 [=#vpu]
 = IMX6 VPU - Video Processing Unit (Codec Support)
-The Video Processing Unit (VPU) in the IMX6 is a CODA960 licensed IP block provided by Chips&Media supporting the following codecs:
+The Video Processing Unit (VPU) in the IMX6 is a CODA960 licensed IP block provided by Chips&Media supporting the following codecs^^^1^^^:
 
 Encode:
@@ -44 +44 @@
   * libfslcodec-* - various gstreamer libraries
 
+Notes:
+ 1. **support for certain codecs may require software from NXP**
+ 2. The CODA960 encoder requires NV12/I420/YV12 YUV pixel formats with rec709 colorimetry
+
 Documentation:
  * Yocto BSP's - i.MX_6_VPU_Application_Programming_Interface_Linux_Reference_Manual.pdf (from the Freescale i.MX6 Yocto BSP releases which you must download from Freescale)
@@ -65 +69 @@
 [=#coda]
 == Kernel Driver (coda)
-'''Note that coda support for the IMX6 was added to Linux in the 3.16 kernel. This page applies to Linux 3.16 and beyond. If you are using a kernel earlier than that for the Ventana IMX6 based boards (such as the Gateworks 3.14 kernel) you will need to refer the Yocto GStreamer pages documenting the proprietary VPU drivers and software from Freescale:
- * [wiki:Yocto/gstreamer]
- * [wiki:Yocto/gstreamer/compositing]
- * [wiki:Yocto/gstreamer/latency]
- * [wiki:Yocto/gstreamer/multimedia]
- * [wiki:Yocto/gstreamer/streaming]
- * [wiki:Yocto/gstreamer/video]
-'''
-
-The Linux [https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/drivers/media/platform/coda coda] media driver as of Linux 3.16 supports the CODA960 in the IMX6 and currently provides access to H264 encode/decode, MPEG4 encode/decode, and MPEG2 decode.
+The Linux [https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/drivers/media/platform/coda coda] media driver as of Linux 3.16 supports the CODA960 in the IMX6 and currently provides access to the following:
+ * decode
+  - H264
+  - MPEG4
+  - MPEG2
+ * encode:
+  - H264
+  - MPEG4
+
+If the CODA driver is enabled in the kernel (CONFIG_VIDEO_CODA=m) and firmware is able to be loaded from {{{/lib/firmware/vpu}}} two {{{/dev/videoN}}} devices are created (one for encode, the other for decode):
+{{{#!bash
+root@imx6q-gw5404:~/# dmesg | grep coda
+[   12.893365] coda 2040000.vpu: Direct firmware load for vpu_fw_imx6q.bin failed with error -2
+[   12.893389] coda 2040000.vpu: Falling back to syfs fallback for: vpu_fw_imx6q.bin
+[   15.168874] coda 2040000.vpu: Using fallback firmware vpu/vpu_fw_imx6q.bin
+[   15.201391] coda 2040000.vpu: Firmware code revision: 570363
+[   15.201421] coda 2040000.vpu: Initialized CODA960.
+[   15.201433] coda 2040000.vpu: Firmware version: 3.1.1
+[   15.205867] coda 2040000.vpu: codec registered as /dev/video[8-9]
+root@imx6q-gw5404:~/# cat /sys/class/video4linux/video8/name 
+coda-encoder
+root@imx6q-gw5404:~/# cat /sys/class/video4linux/video9/name 
+coda-decoder
+}}}
+
+Note that the CODA960 encoder requires NV12/I420/YV12 YUV pixel formats with rec709 colorimetry.
+
+Note also that the CODA driver requires CMA memory for buffers when it is used. Make sure to provide the kernel with enough CMA memory with the kernel command-line (ie 'cma=64M' for 64MB which should be enough)
 
 Encoder and Decoder options are exposed through the v4l2 control IDs (CID) and can be listed with the {{{v4l2-ctl -L}}} and {{{v4l2-ctl -l}}} parameters on the devices exposed by the coda driver:
@@ -192 +214 @@
 }}}
 
+Note that the CODA960 encoder requires NV12/I420/YV12 YUV pixel formats with rec709 colorimetry
 
 Examples:
  * Encode and stream 1080p videotestsrc using UDP/RTP/H264:
 {{{#!bash
-gst-launch-1.0 videotestsrc ! 'video/x-raw, width=1920, height=1080, framerate=30/1, format=NV12, colorimetry=bt709' ! v4l2h264enc output-io-mode=4 ! rtph264pay ! udpsink host=$SERVER port=5000
+gst-launch-1.0 videotestsrc ! \
+  'video/x-raw,width=1920,height=1080,framerate=30/1,format=NV12,colorimetry=bt709' ! \
+  v4l2h264enc output-io-mode=4 ! rtph264pay ! udpsink host=$SERVER port=5000
 }}}
  * Decode and display an H264 video stream:
 {{{#!bash
-gst-launch-1.0 udpsrc port=5000 ! application/x-rtp,payload=96 ! rtph264depay ! v4l2h264dec ! kmssink
+gst-launch-1.0 udpsrc port=5000 ! \
+  application/x-rtp,payload=96 ! \
+  rtph264depay ! v4l2h264dec ! kmssink
 }}}
 
 === Troubleshooting
-- If you do not have the VPU firmware installed you will see these elements. 
+- If you do not have the VPU firmware installed you will see the {{{/dev/videoN}}} devices associated with the coda driver. 
 - CODA driver needs CMA memory.
  - In bootloader "setenv extra cma=64M"