Bug 5331

Summary: error play video via gstreamer with "mfw_isink"
Product: [Build System, Metadata & Runtime] BSPs Reporter: jojo <rjiejie>
Component: bsps-meta-fsl-armAssignee: Otavio Salvador <otavio>
Status: RESOLVED OBSOLETE QA Contact:
Severity: critical    
Priority: Medium CC: angolini, dvhart, richard.purdie
Version: 1.5   
Target Milestone: Future   
Hardware: Other   
OS: arm   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: Don't know

Description jojo 2013-10-09 15:25:00 UTC 
I collect much more detail of this issue about for play video streaming with gstreamer with plugin "mfw_isink" in yocto branch dora,


* video pipe line

pipleline: appsrc is-live=true do-timestamp=true caps="image/jpeg, width=1920, height=800" name="appsrc" ! decodebin2 ! mfw_isink name="appsink" disp-width=1910 disp-height=795 axis-top=153 axis-left=5

set color key
MFW_GST_ISINK_PLUGIN 3.0.8 build on Oct  9 2013 10:34:59.
[INFO]  Product Info: i.MX6Q/D/S
vpudec versions :)
        plugin: 3.0.8
        wrapper: 1.0.38(VPUWRAPPER_ARM_LINUX Build on Oct  8 2013 18:01:07)
        vpulib: 5.4.15
        firmware: 2.3.10.40778
[INFO]  bitstreamMode 1, chromaInterleave 0, mapType 0, tiled2LinearEnable 0
hwbuf allocator zone(2306048) created
can not create threadmfw_gst_isink_setcaps:1489
VS0 created. in fmt[I420] win(0,0-1920,800:1920x800) out win(5,153-1915,948:1910x795)
set deinterlace mode 0
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq
vss/mfw_gst_vss_common.c:1003 ioctl error, return -1
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq
vss/mfw_gst_vss_common.c:1003 ioctl error, return -1
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq
vss/mfw_gst_vss_common.c:1003 ioctl error, return -1
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq


* build version
Build Configuration:
BB_VERSION        = "1.20.0"
BUILD_SYS         = "i686-linux"
NATIVELSBSTRING   = "Ubuntu-12.04"
TARGET_SYS        = "arm-poky-linux-gnueabi"
MACHINE           = "imx6qsabresd"
DISTRO            = "poky"
DISTRO_VERSION    = "1.5"
TUNE_FEATURES     = "armv7a vfp neon callconvention-hard cortexa9"
TARGET_FPU        = "vfp-neon"
meta              
meta-yocto        = "(nobranch):4d8ab87d25ea6e59dc88375813ef88ee0ac813d0"
meta-oe           = "(nobranch):8aafddccb03f54923927e9d1c8c80223baf581de"
meta-fsl-arm      = "(nobranch):2076ae7530a7ed2aa40678502598e74b0f533def"
meta-fsl-arm-extra = "(nobranch):cc64dc7e894915e9be4e6ac34e01a4f5c123b7b4"
meta-fsl-demos    = "(nobranch):393b0119d513f9abf7b0570ab0d32b81583dedca"

* local.conf
DL_DIR = "${TOPDIR}/../../downloads"

*boot cmd
mmcargs=setenv bootargs console=${console},${baudrate} root=${mmcroot} video=mxcfb1:off video=mxcfb0:dev=hdmi,1920x1080M@60,if=RGB24 dmfc=3

*startup script
echo 2 > /proc/cpu/alignment
export VSALPHA=1


* relatived hints which i searched from FREESCALE imx community:

** i think about this issue is reported because of my operation on X server at the same time with gstreamer pipe line with "mfw_isink" as description of bellow thread :(
https://community.freescale.com/message/322666#322666


	For a more simple case,
	
	I use the "get-launch" to play video with X server:

	pipe line : gst-launch filesrc location=/var/volatile/transformers3-mjpeg.mp4 typefind=true ! aiurdemux ! vpudec ! mfw_isink disp-width=1910 disp-height=795 axis-top=153 axis-left=5

set color key
MFW_GST_ISINK_PLUGIN 3.0.8 build on Oct  9 2013 10:34:59.
Setting pipeline to PAUSED ...
[INFO]  Product Info: i.MX6Q/D/S
vpudec versions :)
        plugin: 3.0.8
        wrapper: 1.0.38(VPUWRAPPER_ARM_LINUX Build on Oct  8 2013 18:01:07)
        vpulib: 5.4.15
        firmware: 2.3.10.40778
Pipeline is PREROLLING ...
Aiur: 3.0.8 
Core: MPEG4PARSER_06.06.03  build on Jul  3 2013 01:47:47
  mime: video/quicktime; audio/x-m4a; application/x-3gp
  file: /usr/lib/imx-mm/parser/lib_mp4_parser_arm11_elinux.so.3.1
Content Info:
        URI:
              file:///var/volatile/transformers3-mjpeg.mp4
        Idx File:
              /home/root/.aiur/.var.volatile.transformers3-mjpeg.mp4.aidx
        Seekable  : Yes
        Size(byte): 356249742

Movie Info:
        Seekable  : Yes
        Live      : No
        Duration  : 0:02:27.883008000
        ReadMode  : File
        Track     : 2

Track 00 [video_000000] Enabled
        Duration: 0:02:27.872992000
        Language: eng
        Mime:
              image/jpeg, width=(int)1920, height=(int)800, framerate=(fraction)1199/50
Track 01 [audio_000000] Enabled
        Duration: 0:02:27.882000000
        Language: eng
        Mime:
              audio/mpeg, mpegversion=(int)4, channels=(int)2, rate=(int)48000, bitrate=(int)1
              24665, framed=(boolean)true, stream-format=(string)raw, codec_data=(buffer)11905
              6e500
[INFO]  bitstreamMode 1, chromaInterleave 0, mapType 0, tiled2LinearEnable 0
hwbuf allocator zone(2306048) created
can not create threadmfw_gst_isink_setcaps:1489
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
VS0 created. in fmt[I420] win(0,0-1920,800:1920x800) out win(5,153-1915,948:1910x795)
New clock: GstSystemClock
set deinterlace mode 0
hwbuf allocator zone(61440imx-ipuv3 imx-ipuv3.0: IDMAC12's EBA0 is not 8-byte aligned
0) created
imx-ipuv3 imx-ipuv3.0: IDMAC11's EBA0 is not 8-byte aligned
hwbuf allocator zone(614400) destroied.
hwbuf allocator zone(614400) created
imx-ipuv3 imx-ipuv3.0: IDMAC12's EBA0 is not 8-byte aligned
imx-ipuv3 imx-ipuv3.0: IDMAC11's EBA0 is not 8-byte aligned
hwbuf allocator zone(614400) destroied.
hwbuf allocator zone(614400) created
imx-ipuv3 imx-ipuv3.0: IDMAC12's EBA0 is not 8-byte aligned
imx-ipuv3 imx-ipuv3.0: IDMAC11's EBA0 is not 8-byte aligned
hwbuf allocator zone(614400) destroied.

the following WARNing is reported when you active the X server window, looks like menu of mouse right is active,

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000



	The screen is black about for 2 ~ 3 seconds when the one Warning is reported, and then restore normal display,

	that is said Warning is reported once, black screen once :(

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

	After much more Warning later, the bellow Error is reported, the HDMI screen is black complete, display no signal :( i need to reset the system to restore :(

vss/mfw_gst_vss_common.c:1003 ioctl error, return -1
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq
vss/mfw_gst_vss_common.c:1003 ioctl error, return -1
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq
vss/mfw_gst_vss_common.c:1003 ioctl error, return -1
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000
imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000
mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq
Comment 1 Darren Hart 2013-10-10 14:49:54 UTC 
Is this related/dup of Bug 3781?
Comment 2 jojo 2013-10-10 17:03:36 UTC 
no, i think about the Bug 3781 is just link problems and i have done bellow to workaround:
  cd /usr/lib
  ln -s libgstfsl-0.10.so.0 libgstfsl-0.10.so

all my testing/report is behind fixing the bug 3781

(In reply to comment #1)
> Is this related/dup of Bug 3781?
Comment 3 Daiane 2015-10-21 16:24:41 UTC 
@jojo (In reply to comment #2)
> no, i think about the Bug 3781 is just link problems and i have done bellow
> to workaround:
>   cd /usr/lib
>   ln -s libgstfsl-0.10.so.0 libgstfsl-0.10.so
> 
> all my testing/report is behind fixing the bug 3781
> 
> (In reply to comment #1)
> > Is this related/dup of Bug 3781?

Can you, please, test again now that we only support gstreamer 1.0?
Comment 4 Richard Purdie 2017-06-15 15:09:57 UTC 
No reply to the question in 2 years and believed to be fixed so closing.