Bug 4155 - i.MX6: VPU plugins for GStreamer do not work with appsink
Summary: i.MX6: VPU plugins for GStreamer do not work with appsink
Status: RESOLVED WONTFIX
Alias: None
Product: BSPs
Classification: Build System, Metadata & Runtime
Component: bsps-meta-fsl-arm (show other bugs)
Version: 1.3
Hardware: Other arm
: Medium major
Target Milestone: Future
Assignee: Otavio Salvador
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2013-03-30 16:43 UTC by Carlos Rafael Giani
Modified: 2019-01-31 19:07 UTC (History)
9 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments
Output of manual pipeline, zipped due to size (8.89 KB, application/zip)
2013-03-30 16:43 UTC, Carlos Rafael Giani
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Carlos Rafael Giani 2013-03-30 16:43:56 UTC
Created attachment 1143 [details]
Output of manual pipeline, zipped due to size

Hello,
 
I have been using the GStreamer plugins for i.MX6 hardware accelerated video decoding using a Yocto-based rootfs. I used the recipes from meta-fsl-arm for building. MACHINE was sed to "imx6qsabresd". I did not use meta-oe , just poky danny and meta-fsl-arm (danny branch).
 
This gave me a kernel 3.0.35, and the following package versions:
firmware-imx-vpu-imx6q - 12.09.01-r4.0
gst-fsl-plugin - 3.0.1-r9.1
imx-audio - 0.1-r4
imx-lib - 12.09.01-r4.0
libfslparser - 3.0.1-r1
libfslvpuwrap3 - 1.0.17-r0
libgal-common-mx6 - 12.09.01-r1.0
 
When I tried to play a h264 video with GStreamer's playbin2 , it worked fine:
gst-launch-0.10 playbin2 uri=file:///media/mmcblk1p3/sintel_trailer-1080p.mp4
 
However, when I use an appsink as videosink, it breaks down:
gst-launch-0.10 playbin2 uri=file:///media/mmcblk1p3/sintel_trailer-1080p.mp4 video-sink="appsink"

I get errors like:

 
0:00:00.531415996  1015 0x2b825d80 WARN          mfw_aacdecoder mfw_gst_aacdec.c:1724:mfw_gst_aacdec_data: not able to push the data
0:00:00.560362996  1015 0x2b825d80 WARN          mfw_aacdecoder mfw_gst_aacdec.c:1724:mfw_gst_aacdec_data: not able to push the data
0:00:00.561086330  1015 0x2b825d80 WARN          mfw_aacdecoder mfw_gst_aacdec.c:1724:mfw_gst_aacdec_data: not able to push the data
0:00:00.601098330  1015 0x2b825c60 WARN                  vpudec vpudec.c:1541:gst_vpudec_chain: Got no frame buffer message, return 0x89, 8 frames in displaying queue!!
0:00:00.601788996  1015 0x2b825c60 WARN                  vpudec vpudec.c:1541:gst_vpudec_chain: Got no frame buffer message, return 0x89, 8 frames in displaying queue!!
0:00:00.601995329  1015 0x2b825d80 WARN          mfw_aacdecoder mfw_gst_aacdec.c:1724:mfw_gst_aacdec_data: not able to push the data
0:00:00.602423663  1015 0x2b825c60 WARN                  vpudec vpudec.c:1541:gst_vpudec_chain: Got no frame buffer message, return 0x89, 8 frames in displaying queue!!
0:00:00.602734329  1015 0x2b825d80 WARN          mfw_aacdecoder mfw_gst_aacdec.c:1724:mfw_gst_aacdec_data: not able to push the data
0:00:00.603029996  1015 0x2b825c60 WARN                  vpudec vpudec.c:1541:gst_vpudec_chain: Got no frame buffer message, return 0x89, 8 frames in displaying queue!!
0:00:00.603659329  1015 0x2b825c60 WARN                  vpudec vpudec.c:1541:gst_vpudec_chain: Got no frame buffer message, return 0x89, 8 frames in displaying queue!!
0:00:00.604238663  1015 0x2b825d80 WARN          mfw_aacdecoder mfw_gst_aacdec.c:1724:mfw_gst_aacdec_data: not able to push the data
0:00:00.604373663  1015 0x2b825c60 WARN                  vpudec vpudec.c:1541:gst_vpudec_chain: Got no frame buffer message, return 0x89, 8 frames in displaying queue!!
0:00:00.604993996  1015 0x2b825c60 WARN                  vpudec vpudec.c:1541:gst_vpudec_chain: Got no frame buffer message, return 0x89, 8 frames in displaying queue!!
0:00:00.605017996  1015 0x2b825d80 WARN          mfw_aacdecoder mfw_gst_aacdec.c:1724:mfw_gst_aacdec_data: not able to push the data
0:00:00.605644663  1015 0x2b825c60 WARN                  vpudec vpudec.c:1541:gst_vpudec_chain: Got no frame buffer message, return 0x89, 8 frames in displaying queue!!
0:00:00.605856996  1015 0x2b825d80 WARN          mfw_aacdecoder mfw_gst_aacdec.c:1724:mfw_gst_aacdec_data: not able to push the data
0:00:00.606362329  1015 0x2b825c60 WARN                  vpudec vpudec.c:1541:gst_vpudec_chain: Got no frame buffer message, return 0x89, 8 frames in displaying queue!!
0:00:00.606614329  1015 0x2b825d80 WARN          mfw_aacdecoder mfw_gst_aacdec.c:1724:mfw_gst_aacdec_data: not able to push the data
0:00:00.606981329  1015 0x2b825c60 WARN                  vpudec vpudec.c:1541:gst_vpudec_chain: Got no frame buffer message, return 0x89, 8 frames in displaying queue!!
0:00:00.607351996  1015 0x2b825d80 WARN          mfw_aacdecoder mfw_gst_aacdec.c:1724:mfw_gst_aacdec_data: not able to push the data
0:00:00.607581663  1015 0x2b825c60 WARN                  vpudec vpudec.c:1541:gst_vpudec_chain: Got no frame buffer message, return 0x89, 8 frames in displaying queue!!
0:00:00.608115996  1015 0x2b825d80 WARN          mfw_aacdecoder mfw_gst_aacdec.c:1724:mfw_gst_aacdec_data: not able to push the data
0:00:00.608310330  1015 0x2b825c60 WARN                  vpudec vpudec.c:1541:gst_vpudec_chain: Got no frame buffer message, return 0x89, 8 frames in displaying queue!!


It also happens with a manually created pipeline, and logged the errors by setting GST_DEBUG to "2,*aiur*:5,*vpudec*:5" . Here is the pipeline:

  gst-launch-0.10 filesrc location=sintel_trailer-1080p.mp4 ! "video/quicktime, variant=(string)iso" ! aiurdemux name=d     "d.video_0000" ! vpudec ! appsink

Using qtdemux instead of aiurdemux didn't work. I got no playback.

Other sinks (filesink, fakesink..) work.
Comment 1 Otavio Salvador 2013-03-30 16:47:00 UTC
Have you try to reproduce this issue with master, which has 1.1.0 based codecs?
Comment 2 Carlos Rafael Giani 2013-03-30 16:49:00 UTC
Addendum: it happened with the master branch of meta-fsl-arm as well.
Comment 3 Ashwin Kirpalani 2013-08-08 04:05:42 UTC
Have you tested if this problem exists with the latest gst-fsl-plugins (ver 3.0.8)?
Comment 4 Dominik Holland 2013-09-12 07:18:07 UTC
I have tested it with ver 3.0.8 and it's still the same problem.
Comment 5 Otavio Salvador 2014-05-22 19:06:56 UTC
Can someone try to reproduce it in Daisy?
Comment 6 thomas.senyk 2014-06-04 13:55:21 UTC
(In reply to comment #5)
> Can someone try to reproduce it in Daisy?

tested with Daisy checkout from Monday with 3.10.17 kernel.
meta-fsl-arm* is all master, also from Monday.

board: nitrogen6x

test: gst-launch-0.10 playbin2 uri=file:///home/root/videoplayer/sintel_trailer-1080p.mp4 video-sink="appsink"

log: http://pastebin.com/wYRjBPuW

I hear audio for ~1/2minute (then silence).
No video.
.. both might be expected?
Comment 7 Stephen K Jolley 2014-06-30 19:45:59 UTC
Needinfo response on 6/4.
Comment 8 Carlos Alberto Lopez Perez 2017-08-16 16:33:35 UTC
Here is more info about this issue : https://github.com/Freescale/gstreamer-imx/issues/91
Comment 9 Stephen K Jolley 2019-01-31 19:07:42 UTC
bsps-meta-fsl-arm issues are now tracked in GitHub.  Please see: https://github.com/Freescale/meta-freescale