jeffycn / rockchip_mirrors Goto Github PK

Mirrors of a few Rockchip BSP repositories, some others in https://github.com/JeffyCN/mirrors.

License: Other

Makefile 68.71% Shell 7.58% Batchfile 0.29% C 8.89% C++ 0.84% Arc 0.05% Tcl 0.17% Python 11.77% M4 0.05% Lua 0.21% CMake 0.09% Dockerfile 0.12% Perl 0.75% Lex 0.11% Yacc 0.27% Java 0.05% Forth 0.03% Gnuplot 0.01% JavaScript 0.01% SMT 0.01%

rockchip_mirrors's People

Contributors

Stargazers

Watchers

Forkers

feixuezhang

rockchip_mirrors's Issues

Hardware decoding

hi, Jeffy
Can you give an example of hardware decoding?
I have a splash screen when playing 25fps video on 3326 platform with the following command
gst-launch-1.0 filesrc location=vui_1.mov ! decodebin ! videoconvert ! videoscale ! autovideosink
Hardware decoding

Should GstMppDec be GstMppEnc in file gst/rockchipmpp/gstmppenc.h?

I was looking through the code with a view to using MPP directly (without GStreamer) and just noticed

rockchip_mirrors/gst/rockchipmpp/gstmppenc.h

Line 36 in b88d30d

typedef struct _GstMppDec GstMppDec;

Which probably should be
typedef struct _GstMppEnc GstMppEnc;

I'm not sure what the implications of this are but it looks wrong on first view

Gstreamer videoconvert / videoscale support

Hi @JeffyCN ,

I would like to scale a video but haven't found a way to do so. Previous versions had rgaconvert where you could scale the image.
Interesting that if i scale the image to same size it works, For example, a 1920x1080 video:

gst-launch-1.0 -v filesrc location=~/Videos/jellyfish-5-mbps-hd-h264.mkv ! matroskademux ! h264parse ! mppvideodec ! videoconvert ! video/x-raw,format=NV12,width=1920,height=1080 ! glimagesink

Tried with videoscale:

gst-launch-1.0 -v filesrc location=~/Videos/jellyfish-5-mbps-hd-h264.mkv ! matroskademux ! h264parse ! mppvideodec ! videoscale ! video/x-raw,width=1920,height=1080 ! glimagesink

If a scale like so:

gst-launch-1.0 -v filesrc location=~/Videos/jellyfish-5-mbps-hd-h264.mkv ! matroskademux ! h264parse ! mppvideodec ! videoscale ! video/x-raw,width=1920,height=540 ! glimagesink

I get an error.

Can you please provide the correct way to scale the image, or there is no support?

[gstreamer-rockchip]Rendering on Android consume a lot of CPU

Env:

Kernel info: Linux localhost 5.10.66 #394 SMP PREEMPT Fri Jul 7 13:30:47 CST 2023 aarch64;
GStreamer v1.22.6;
gstreamer-rockchip latest code;
single H.264 RTSP video stream(1920x1080@25fps)

GStreamer pipelines:

without renderer, works great low CPU usage, very fast at decoding.

rtspsrc location=%s ! rtph264depay ! h264parse ! mppvideodec ! fakesink

with renderer(glimagesink), the CPU up to 105%

 rtspsrc location=%s ! rtph264depay ! h264parse ! mppvideodec ! glimagesink

I am using SurfaceView as renderer on Android, in native I got the ANativeWindow from ANativeWindow_fromSurface(env, surface), then I use gst_video_overlay_set_window_handle(GST_VIDEO_OVERLAY(video_sink), (guintptr)window) pass to GStreamer.
Did I miss something? Do I need apply some patches in GStreamer? @JeffyCN sorry to bother you, could you give me some advice? thanks.

gst_mpp_dec_get_gst_buffer:<mppjpegdec0> unable to convert frame / can't process this frame

Hi,
I cannot get RGB format from mppjpegdec. I had an older version shipped with the debian gst that was working fine for all formats apart from RGB. For the RGB issue then I created isseu #31 . The same was marked as solved but now when I tested it even the RGBA is not working.

RGB error:

root@firefly:~/mirrors-gstreamer-rockchip/builddir# gst-launch-1.0 -v --gst-debug=2 shmsrc socket-path=/var/ramfs/camera_shm ! image/jpeg,width=3840,height=2160,framerate=20/1 ! mppjpegdec format=BGR dma-feature=1 max-errors=-1 ! fpsdisplaysink video-sink=fakesink text-overlay=false -ve
Setting pipeline to PAUSED ...
Pipeline is PREROLLING ...
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = true
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)20/1, parsed=(boolean)true
0:00:00.062638634 19674   0x559f432c60 WARN              video-info video-info.c:196:validate_colorimetry: color matrix RGB is only supported with RGB format, NV12 is not
0:00:00.062665759 19674   0x559f432c60 WARN              video-info video-info.c:520:gst_video_info_from_caps: invalid colorimetry, using default
/GstPipeline:pipeline0/GstMppJpegDec:mppjpegdec0.GstPad:src: caps = video/x-raw(memory:DMABuf), format=(string)BGR, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)sRGB, framerate=(fraction)20/1
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw(memory:DMABuf), format=(string)BGR, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)sRGB, framerate=(fraction)20/1
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-raw(memory:DMABuf), format=(string)BGR, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)sRGB, framerate=(fraction)20/1
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink: caps = video/x-raw(memory:DMABuf), format=(string)BGR, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)sRGB, framerate=(fraction)20/1
/GstPipeline:pipeline0/GstMppJpegDec:mppjpegdec0.GstPad:sink: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)20/1, parsed=(boolean)true
0:00:00.062956842 19674   0x559f432c60 WARN            videodecoder gstvideodecoder.c:2573:gst_video_decoder_chain:<mppjpegdec0> Received buffer without a new-segment. Assuming timestamps start from 0.
0:00:00.073716567 19674   0x559f433180 WARN                  mppdec gstmppdec.c:591:gst_mpp_dec_get_frame:<mppjpegdec0> MPP is not able to generate pts
0:00:00.074007942 19674   0x559f433180 WARN                  mppdec gstmppdec.c:821:gst_mpp_dec_get_gst_buffer:<mppjpegdec0> unable to convert frame
0:00:00.074093109 19674   0x559f433180 WARN                  mppdec gstmppdec.c:966:gst_mpp_dec_loop:<mppjpegdec0> can't process this frame
0:00:00.133421321 19674   0x559f433180 WARN                  mppdec gstmppdec.c:821:gst_mpp_dec_get_gst_buffer:<mppjpegdec0> unable to convert frame
0:00:00.133531280 19674   0x559f433180 WARN                  mppdec gstmppdec.c:966:gst_mpp_dec_loop:<mppjpegdec0> can't process this frame
0:00:00.196971665 19674   0x559f433180 WARN                  mppdec gstmppdec.c:821:gst_mpp_dec_get_gst_buffer:<mppjpegdec0> unable to convert frame
0:00:00.197036707 19674   0x559f433180 WARN                  mppdec gstmppdec.c:966:gst_mpp_dec_loop:<mppjpegdec0> can't process this frame
0:00:00.254252374 19674   0x559f433180 WARN                  mppdec gstmppdec.c:821:gst_mpp_dec_get_gst_buffer:<mppjpegdec0> unable to convert frame

RGBA error:

root@firefly:~/mirrors-gstreamer-rockchip/builddir# gst-launch-1.0 -v --gst-debug=2 shmsrc socket-path=/var/ramfs/camera_shm ! image/jpeg,width=3840,height=2160,framerate=20/1 ! mppjpegdec format=BGR565 dma-feature=1 max-errors=-1 ! fpsdisplaysink video-sink=fakesink text-overlay=false -ve
Setting pipeline to PAUSED ...
Pipeline is PREROLLING ...
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = true
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)20/1, parsed=(boolean)true
0:00:00.060338336 19830   0x55a3276060 ERROR             mppjpegdec gstmppjpegdec.c:281:gst_mpp_jpeg_dec_set_format:<mppjpegdec0> unsupported video format
0:00:00.060379169 19830   0x55a3276060 WARN            videodecoder gstvideodecoder.c:811:gst_video_decoder_setcaps:<mppjpegdec0> Subclass refused caps
0:00:00.060823670 19830   0x55a3276060 ERROR             mppjpegdec gstmppjpegdec.c:281:gst_mpp_jpeg_dec_set_format:<mppjpegdec0> unsupported video format
0:00:00.060850503 19830   0x55a3276060 WARN            videodecoder gstvideodecoder.c:811:gst_video_decoder_setcaps:<mppjpegdec0> Subclass refused caps
0:00:00.061242504 19830   0x55a3276060 ERROR             mppjpegdec gstmppjpegdec.c:281:gst_mpp_jpeg_dec_set_format:<mppjpegdec0> unsupported video format
0:00:00.061267295 19830   0x55a3276060 WARN            videodecoder gstvideodecoder.c:811:gst_video_decoder_setcaps:<mppjpegdec0> Subclass refused caps
0:00:00.061321254 19830   0x55a3276060 WARN                 basesrc gstbasesrc.c:3127:gst_base_src_loop:<shmsrc0> error: Internal data stream error.
0:00:00.061337587 19830   0x55a3276060 WARN                 basesrc gstbasesrc.c:3127:gst_base_src_loop:<shmsrc0> error: streaming stopped, reason not-negotiated (-4)
ERROR: from element /GstPipeline:pipeline0/GstShmSrc:shmsrc0: Internal data stream error.
Additional debug info:
../libs/gst/base/gstbasesrc.c(3127): gst_base_src_loop (): /GstPipeline:pipeline0/GstShmSrc:shmsrc0:
streaming stopped, reason not-negotiated (-4)
ERROR: pipeline doesn't want to preroll.
Setting pipeline to NULL ...
0:00:00.061796088 19830   0x55a3276060 ERROR             mppjpegdec gstmppjpegdec.c:281:gst_mpp_jpeg_dec_set_format:<mppjpegdec0> unsupported video format
0:00:00.061819129 19830   0x55a3276060 WARN            videodecoder gstvideodecoder.c:811:gst_video_decoder_setcaps:<mppjpegdec0> Subclass refused caps
0:00:00.062001130 19830   0x55a3276060 ERROR             mppjpegdec gstmppjpegdec.c:281:gst_mpp_jpeg_dec_set_format:<mppjpegdec0> unsupported video format
0:00:00.062017171 19830   0x55a3276060 WARN            videodecoder gstvideodecoder.c:811:gst_video_decoder_setcaps:<mppjpegdec0> Subclass refused caps
Freeing pipeline ...
root@firefly:~/mirrors-gstreamer-rockchip/builddir# 
root@firefly:~/mirrors-gstreamer-rockchip/builddir# 
root@firefly:~/mirrors-gstreamer-rockchip/builddir# 
root@firefly:~/mirrors-gstreamer-rockchip/builddir# gst-launch-1.0 -v --gst-debug=2 shmsrc socket-path=/var/ramfs/camera_shm ! image/jpeg,width=3840,height=2160,framerate=20/1 ! mppjpegdec format=RGBA dma-feature=1 max-errors=-1 ! fpsdisplaysink video-sink=fakesink text-overlay=false -ve
Setting pipeline to PAUSED ...
Pipeline is PREROLLING ...
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = true
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)20/1, parsed=(boolean)true
0:00:00.116969648 20414   0x5583f1ec60 ERROR             mppjpegdec gstmppjpegdec.c:281:gst_mpp_jpeg_dec_set_format:<mppjpegdec0> unsupported video format
0:00:00.117071440 20414   0x5583f1ec60 WARN            videodecoder gstvideodecoder.c:811:gst_video_decoder_setcaps:<mppjpegdec0> Subclass refused caps
0:00:00.117737608 20414   0x5583f1ec60 ERROR             mppjpegdec gstmppjpegdec.c:281:gst_mpp_jpeg_dec_set_format:<mppjpegdec0> unsupported video format
0:00:00.117797400 20414   0x5583f1ec60 WARN            videodecoder gstvideodecoder.c:811:gst_video_decoder_setcaps:<mppjpegdec0> Subclass refused caps
0:00:00.118271650 20414   0x5583f1ec60 ERROR             mppjpegdec gstmppjpegdec.c:281:gst_mpp_jpeg_dec_set_format:<mppjpegdec0> unsupported video format
0:00:00.118327067 20414   0x5583f1ec60 WARN            videodecoder gstvideodecoder.c:811:gst_video_decoder_setcaps:<mppjpegdec0> Subclass refused caps
0:00:00.118507025 20414   0x5583f1ec60 WARN                 basesrc gstbasesrc.c:3127:gst_base_src_loop:<shmsrc0> error: Internal data stream error.
0:00:00.118564775 20414   0x5583f1ec60 WARN                 basesrc gstbasesrc.c:3127:gst_base_src_loop:<shmsrc0> error: streaming stopped, reason not-negotiated (-4)
ERROR: from element /GstPipeline:pipeline0/GstShmSrc:shmsrc0: Internal data stream error.
Additional debug info:
../libs/gst/base/gstbasesrc.c(3127): gst_base_src_loop (): /GstPipeline:pipeline0/GstShmSrc:shmsrc0:
streaming stopped, reason not-negotiated (-4)
ERROR: pipeline doesn't want to preroll.
Setting pipeline to NULL ...
0:00:00.119711902 20414   0x5583f1ec60 ERROR             mppjpegdec gstmppjpegdec.c:281:gst_mpp_jpeg_dec_set_format:<mppjpegdec0> unsupported video format
0:00:00.119783069 20414   0x5583f1ec60 WARN            videodecoder gstvideodecoder.c:811:gst_video_decoder_setcaps:<mppjpegdec0> Subclass refused caps
0:00:00.120452153 20414   0x5583f1ec60 ERROR             mppjpegdec gstmppjpegdec.c:281:gst_mpp_jpeg_dec_set_format:<mppjpegdec0> unsupported video format
0:00:00.120509903 20414   0x5583f1ec60 WARN            videodecoder gstvideodecoder.c:811:gst_video_decoder_setcaps:<mppjpegdec0> Subclass refused caps
Freeing pipeline ...
root@firefly:~/mirrors-gstreamer-rockchip/builddir#

Error while building latest version

>>> busybox 1.34.1 Extracting
bzcat /home/ap/rockchip/rockchip_mirrors/dl/busybox-1.34.1.tar.bz2 | /home/ap/rockchip/rockchip_mirrors/output/host/bin/tar --strip-components=1 -C /home/ap/rockchip/rockchip_mirrors/output/build/busybox-1.34.1   -xf -
>>> busybox 1.34.1 Patching

Applying 0001-networking-libiproute-use-linux-if_packet.h-instead-.patch using patch: 
patching file networking/libiproute/iplink.c

Applying 0002-Makefile.flags-strip-non-l-arguments-returned-by-pkg.patch using patch: 
patching file Makefile.flags

Applying 0003-busybox-support-chinese-display-in-terminal.patch using patch: 
patching file libbb/printable_string.c
patching file libbb/unicode.c

Applying 0004-halt-Support-rebooting-with-arg.patch using patch: 
patching file init/halt.c
for f in board/rockchip/common/base/busybox.config ; do if [ ! -f "${f}" ]; then printf "Kconfig file or fragment '%s' for '%s' does not exist\n" "${f}" "busybox"; exit 1; fi; done
Kconfig file or fragment 'board/rockchip/common/base/busybox.config' for 'busybox' does not exist
make[1]: *** [package/busybox/busybox.mk:419: board/rockchip/common/base/busybox.config] Błąd 1
make: *** [Makefile:83: _all] Błąd 2

A workaround:

touch board/rockchip/common/base/busybox.config works, but this does not look like a proper solution.

mppjpegdec hangs after several minutes on RK3588

Hi,
after running decode with mppjpegdec for several minutes it errors and on restart the below appears. I'm using RK3588 ( Firefly AIO-3588Q)

Initial error:

0:01:44.886656827  5950   0x55b7a95460 WARN                 basesrc gstbasesrc.c:3127:gst_base_src_loop:<v4l2src0> error: Internal data stream error.
0:01:44.886713411  5950   0x55b7a95460 WARN                 basesrc gstbasesrc.c:3127:gst_base_src_loop:<v4l2src0> error: streaming stopped, reason error (-5)
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Internal data stream error.
Additional debug info:
../libs/gst/base/gstbasesrc.c(3127): gst_base_src_loop (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
streaming stopped, reason error (-5)
Execution ended after 0:01:44.796785884
Setting pipeline to NULL ...
0:01:45.118470525  5950   0x55b7a954c0 WARN                 shmsink gstshmsink.c:840:pollthread_func:<shmsink0> error: Failed waiting on fd activity
0:01:45.118545776  5950   0x55b7a954c0 WARN                 shmsink gstshmsink.c:840:pollthread_func:<shmsink0> error: gst_poll_wait returned -1, errno: 16
ERROR: from element /GstPipeline:pipeline0/GstShmSink:shmsink0: Failed waiting on fd activity
Additional debug info:
../sys/shm/gstshmsink.c(840): pollthread_func (): /GstPipeline:pipeline0/GstShmSink:shmsink0:
gst_poll_wait returned -1, errno: 16
Freeing pipeline ...
root@firefly:~#

When I try to restart:

root@firefly:~# gst-launch-1.0 -v --gst-debug=2 v4l2src device=/dev/video12 ! image/jpeg,width=3840,height=2160,framerate=30/1 ! mppjpegdec ! queue ! fakesink
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstMppJpegDec:mppjpegdec0.GstPad:src: caps = video/x-raw(memory:DMABuf), format=(string)NV12, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)mpeg2, colorimetry=(string)2:4:5:1, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstQueue:queue0.GstPad:sink: caps = video/x-raw(memory:DMABuf), format=(string)NV12, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)mpeg2, colorimetry=(string)2:4:5:1, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstQueue:queue0.GstPad:src: caps = video/x-raw(memory:DMABuf), format=(string)NV12, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)mpeg2, colorimetry=(string)2:4:5:1, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-raw(memory:DMABuf), format=(string)NV12, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)mpeg2, colorimetry=(string)2:4:5:1, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstMppJpegDec:mppjpegdec0.GstPad:sink: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
0:00:00.362207292  6497   0x55bee02400 WARN          v4l2bufferpool gstv4l2bufferpool.c:814:gst_v4l2_buffer_pool_start:<v4l2src0:pool0:src> Uncertain or not enough buffers, enabling copy threshold
0:00:00.741355943  6497   0x55bee02400 ERROR                 mppdec gstmppdec.c:1012:gst_mpp_dec_handle_frame:<mppjpegdec0> failed to send packet
0:00:00.741474361  6497   0x55bee02400 WARN                  mppdec gstmppdec.c:1016:gst_mpp_dec_handle_frame:<mppjpegdec0> can't handle this frame
0:00:00.743893758  6497   0x55bee02400 WARN                 basesrc gstbasesrc.c:3127:gst_base_src_loop:<v4l2src0> error: Internal data stream error.
0:00:00.743975426  6497   0x55bee02400 WARN                 basesrc gstbasesrc.c:3127:gst_base_src_loop:<v4l2src0> error: streaming stopped, reason error (-5)
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Internal data stream error.
Additional debug info:
../libs/gst/base/gstbasesrc.c(3127): gst_base_src_loop (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
streaming stopped, reason error (-5)
Execution ended after 0:00:00.506613020
Setting pipeline to NULL ...
0:00:00.761352422  6497   0x55bee05860 WARN                  mppdec gstmppdec.c:563:gst_mpp_dec_get_frame:<mppjpegdec0> MPP is not able to generate pts
Freeing pipeline

Running the same pipe but with jpegdec (works fine)

root@firefly:~# gst-launch-1.0 -v --gst-debug=2 v4l2src device=/dev/video12 ! image/jpeg,width=3840,height=2160,framerate=30/1 ! jpegdec ! queue ! fakesink
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstJpegDec:jpegdec0.GstPad:sink: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
0:00:00.342476843  7009   0x55c1a30400 WARN          v4l2bufferpool gstv4l2bufferpool.c:814:gst_v4l2_buffer_pool_start:<v4l2src0:pool0:src> Uncertain or not enough buffers, enabling copy threshold
/GstPipeline:pipeline0/GstJpegDec:jpegdec0.GstPad:src: caps = video/x-raw, format=(string)I420, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstQueue:queue0.GstPad:sink: caps = video/x-raw, format=(string)I420, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstQueue:queue0.GstPad:src: caps = video/x-raw, format=(string)I420, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-raw, format=(string)I420, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)30/1
^Chandling interrupt.
Interrupt: Stopping pipeline ...
Execution ended after 0:00:03.669727283
Setting pipeline to NULL ...
Freeing pipeline ...
root@firefly:~#

vcodec_service: vcodec_service_cmd_send ioctl VPU_IOC_SET_REG failed ret -1 errno 14 Bad address

mpp: https://github.com/JeffyCN/rockchip_mirrors/tree/mpp
gstreamer-rockchip: https://github.com/JeffyCN/rockchip_mirrors/tree/gstreamer-rockchip
kernel:
merge https://github.com/JeffyCN/rockchip_mirrors/blob/kernel/drivers/video/rockchip/vcodec to https://github.com/friendlyarm/kernel-rockchip/blob/kernel/drivers/video/rockchip/vcodec

GStreamer launch with error:

vcodec_service: vcodec_service_cmd_send ioctl VPU_IOC_SET_REG failed ret -1 errno 14 Bad address

gstreamer BGR support?

BGR is the default format for OpenCV, but it seems BGR24 not supported by this version of gstreamer in videoconvert command.

gst-inspect-1.0. videoconvert

Pad Templates:
  SINK template: 'sink'
    Availability: Always
    Capabilities:
      video/x-raw
                 format: { (string)ABGR64_LE, (string)BGRA64_LE, (string)AYUV64, (string)ARGB64_LE, (string)ARGB64, (string)RGBA64_LE, (string)ABGR64_BE, (string)BGRA64_BE, (string)ARGB64_BE, (string)RGBA64_BE, (string)GBRA_12LE, (string)GBRA_12BE, (string)Y412_LE, (string)Y412_BE, (string)A444_10LE, (string)GBRA_10LE, (string)A444_10BE, (string)GBRA_10BE, (string)A422_10LE, (string)A422_10BE, (string)A420_10LE, (string)A420_10BE, (string)RGB10A2_LE, (string)BGR10A2_LE, (string)Y410, (string)GBRA, (string)ABGR, (string)VUYA, (string)BGRA, (string)AYUV, (string)ARGB, (string)RGBA, (string)A420, (string)AV12, (string)Y444_16LE, (string)Y444_16BE, (string)v216, (string)P016_LE, (string)P016_BE, (string)Y444_12LE, (string)GBR_12LE, (string)Y444_12BE, (string)GBR_12BE, (string)I422_12LE, (string)I422_12BE, (string)Y212_LE, (string)Y212_BE, (string)I420_12LE, (string)I420_12BE, (string)P012_LE, (string)P012_BE, (string)Y444_10LE, (string)GBR_10LE, (string)Y444_10BE, (string)GBR_10BE, (string)r210, (string)I422_10LE, (string)I422_10BE, (string)NV16_10LE32, (string)Y210, (string)v210, (string)UYVP, (string)I420_10LE, (string)I420_10BE, (string)P010_10LE, (string)NV12_10LE32, (string)NV12_10LE40, (string)P010_10BE, (string)Y444, (string)RGBP, (string)GBR, (string)BGRP, (string)NV24, (string)xBGR, (string)BGRx, (string)xRGB, (string)RGBx, (string)BGR, (string)IYU2, (string)v308, (string)RGB, (string)Y42B, (string)NV61, (string)NV16, (string)VYUY, (string)UYVY, (string)YVYU, (string)YUY2, (string)I420, (string)YV12, (string)NV21, (string)NV12, (string)NV12_64Z32, (string)NV12_4L4, (string)NV12_32L32, (string)Y41B, (string)IYU1, (string)YVU9, (string)YUV9, (string)RGB16, (string)BGR16, (string)RGB15, (string)BGR15, (string)RGB8P, (string)GRAY16_LE, (string)GRAY16_BE, (string)GRAY10_LE32, (string)GRAY8 }
                  width: [ 1, 2147483647 ]
                 height: [ 1, 2147483647 ]

What is the best way to add this capability?

[Question] gstreamer-rockchip more than one instance

@JeffyCN
I would like to run more than one instance of rkximagesink, but I get flickering. When one instance is drawing the other is blanking.

Say I have three cameras, but can't run it.

UEFI / EDK2 sources

Could you please mirror the UEFI/EDK2 sources (AKA uefi-monorepo), or is that off-limits at this point?

There are already published sources for it, but the most recent drop was several months ago.

How do I check if the plugin is RGA enabled?

gstreamer:1.18.5, The system is Ubuntu，I found through the debug, LD library that gstreamer does have librga introduced, but when I use the videoconvert component, there is no trace of enablement, and I tried export GST_VIDEO_CONVERT_USE_RGA=1 not even printing rga_api version. How can I check if the plugin is RGA enabled?

can we mirror the source code of xf86-video-armsoc?

@JeffyCN hello~
I have a deb installed on an old rk3288 rootfs image:

 dpkg -l|grep armsoc
ii  xserver-xorg-video-armsoc                     1.9.3                             armhf        X.Org X server -- ARM SoC display driver (transitional package)

This is the debian changelog of that package:

xf86-video-armsoc (1.9.3) testing; urgency=medium

  * new

 -- Jacob Chen <[email protected]>  Fri, 03 NOV 2017 13:17:50 +0200

This version is not compatible with xorg 1.20+, so I want to rebuild this package since armsoc+fbdev+xinerama is the only way I found to light up rk3288 + displaylink usb2.0 multi screen.

linux-rga 仓库哪去了

Need help downloading recent version of RK1808 SDK

Hey Jeffy,

We asked this on redmine also but I would like your opinion also since I am not sure if it will be solved properly on redmine.

We obtained RK1808 sdk from official rockchip repositories and successfully used them so far, but recently we noticed that some of the libraries (RGA, MPP, gstreamer-rockhip) are very old versions and have not been synced up to RK1808.

We obtained RV1126 sdks also from rockchip repositories and observed that those same libraries are very recent versions and the sdk can be built for RV1126 config. However, it cannot be built for RK1808 config, so we cannot update from there also.

How could we get out of this dilemma? What would you suggest we do to find a solution that can work for us?

Cheers

RGA problem with RGBtoYUV converstion

Hello @JeffyCN ,

As mentioned in title, we are converting a grayscale RGB frame to YUV frame using RGA library. Both RGA lib and RGA kernel driver are from same SDK version.
This is what we get as resulting frame after conversion using methods shown in linux-rga's samples/legacy :

Obviously the frame got messed up and the issues is same as the one mentioned in RGA_FAQ.md/Q2.11.

When we convert RGB frame to YUV using " https://github.com/Jerzha/samples-toybrick-rga ", the frame is correctly converted:

Conversion is correct, however the library Jerzha shared is not updated anymore and it makes more sense to use linux-rga library's methods, to be able to add more functionality to our projects. Also this library seems to communicate with rga library using "ioctl" commands, which is very confusing and there is no documentation about how it works.

What went wrong here? What would you suggest to solve this?

Thanks in advance.

gstreamer-rockchip: low framerate when encoding under kenel 6.1

mpp kernel driver version: mpp_service mpp-srv: 6849c1e28b7b author: Ding Wei 2023-12-28 video: rockchip: mpp: px30: fix issue combo_init when device probe
This issue is introduced by commit 3e5d951

gst_mpp_allocator_import_mppbuf:<mppallocator0> failed to get dmafd

The below pipeline is running for a minute or so and fails with error failed to get dmafd.

root@firefly:~# export GST_MPP_NO_RGA=1
root@firefly:~# gst-launch-1.0 --gst-debug=2 v4l2src device=/dev/video12 ! image/jpeg,width=3840,height=2160,framerate=30/1 ! mppjpegdec format=NV12 dma-feature=1 max-errors=-1 ! mpph265enc ! fpsdisplaysink video-sink="fakesink" text-overlay=false -ve
0:00:00.259724930 239311   0x5566f02180 WARN                     mpp gstmpp.c:126:gst_mpp_use_rga: RGA disabled by env (GST_MPP_NO_RGA)
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = true
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstMppJpegDec:mppjpegdec0.GstPad:src: caps = video/x-raw(memory:DMABuf), format=(string)NV12, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)mpeg2, colorimetry=(string)2:4:5:1, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstMppH265Enc:mpph265enc0.GstPad:src: caps = video/x-h265, stream-format=(string)byte-stream, alignment=(string)au, width=(int)3840, height=(int)2160, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-h265, stream-format=(string)byte-stream, alignment=(string)au, width=(int)3840, height=(int)2160, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-h265, stream-format=(string)byte-stream, alignment=(string)au, width=(int)3840, height=(int)2160, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink: caps = video/x-h265, stream-format=(string)byte-stream, alignment=(string)au, width=(int)3840, height=(int)2160, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
/GstPipeline:pipeline0/GstMppH265Enc:mpph265enc0.GstPad:sink: caps = video/x-raw(memory:DMABuf), format=(string)NV12, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)mpeg2, colorimetry=(string)2:4:5:1, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstMppJpegDec:mppjpegdec0.GstPad:sink: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
0:00:00.430072606 239311   0x5566eedb60 WARN          v4l2bufferpool gstv4l2bufferpool.c:814:gst_v4l2_buffer_pool_start:<v4l2src0:pool0:src> Uncertain or not enough buffers, enabling copy threshold
0:00:00.793314357 239311   0x5566eee060 WARN                  mppdec gstmppdec.c:591:gst_mpp_dec_get_frame:<mppjpegdec0> MPP is not able to generate pts
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = true
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 19, dropped: 0, current: 36.59, average: 36.59
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 35, dropped: 0, current: 30.07, average: 33.29
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 50, dropped: 0, current: 29.99, average: 32.23
.
.
.
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 949, dropped: 0, current: 29.90, average: 30.11
0:00:32.522770313 239311   0x5566eee060 ERROR           mppallocator gstmppallocator.c:166:gst_mpp_allocator_import_mppbuf:<mppallocator0> failed to get dmafd

(gst-launch-1.0:239311): GStreamer-CRITICAL **: 09:47:21.490: gst_mini_object_set_qdata: assertion 'object != NULL' failed
0:00:32.524520613 239311   0x5566eee060 ERROR                 mppenc gstmppenc.c:896:gst_mpp_enc_convert:<mpph265enc0> failed to convert frame
0:00:32.524605488 239311   0x5566eee060 ERROR                 mppenc gstmppenc.c:1149:gst_mpp_enc_handle_frame:<mpph265enc0> not negotiated
0:00:32.524645155 239311   0x5566eee060 WARN                  mppenc gstmppenc.c:1153:gst_mpp_enc_handle_frame:<mpph265enc0> can't handle this frame
0:00:32.559221485 239311   0x5566eee060 ERROR           mppallocator gstmppallocator.c:166:gst_mpp_allocator_import_mppbuf:<mppallocator0> failed to get dmafd

(gst-launch-1.0:239311): GStreamer-CRITICAL **: 09:47:21.526: gst_mini_object_set_qdata: assertion 'object != NULL' failed
0:00:32.561445453 239311   0x5566eee060 ERROR                 mppenc gstmppenc.c:896:gst_mpp_enc_convert:<mpph265enc0> failed to convert frame
0:00:32.561555704 239311   0x5566eee060 ERROR                 mppenc gstmppenc.c:1149:gst_mpp_enc_handle_frame:<mpph265enc0> not negotiated
0:00:32.561575829 239311   0x5566eee060 WARN                  mppenc gstmppenc.c:1153:gst_mpp_enc_handle_frame:<mpph265enc0> can't handle this frame
0:00:32.602139853 239311   0x5566eee060 ERROR           mppallocator gstmppallocator.c:166:gst_mpp_allocator_import_mppbuf:<mppallocator0> failed to get dmafd

(gst-launch-1.0:239311): GStreamer-CRITICAL **: 09:47:21.569: gst_mini_object_set_qdata: assertion 'object != NULL' failed
0:00:32.605662912 239311   0x5566eee060 ERROR                 mppenc gstmppenc.c:896:gst_mpp_enc_convert:<mpph265enc0> failed to convert frame
0:00:32.605855704 239311   0x5566eee060 ERROR                 mppenc gstmppenc.c:1149:gst_mpp_enc_handle_frame:<mpph265enc0> not negotiated
0:00:32.605888371 239311   0x5566eee060 WARN                  mppenc gstmppenc.c:1153:gst_mpp_enc_handle_frame:<mpph265enc0> can't handle this frame
0:00:34.591925602 239311   0x5566eedb60 ERROR                 mppdec gstmppdec.c:1075:gst_mpp_dec_handle_frame:<mppjpegdec0> failed to send packet
0:00:34.591971394 239311   0x5566eedb60 WARN                  mppdec gstmppdec.c:1079:gst_mpp_dec_handle_frame:<mppjpegdec0> can't handle this frame
0:00:34.597338669 239311   0x5566eedb60 WARN                 basesrc gstbasesrc.c:3127:gst_base_src_loop:<v4l2src0> error: Internal data stream error.
0:00:34.597369003 239311   0x5566eedb60 WARN                 basesrc gstbasesrc.c:3127:gst_base_src_loop:<v4l2src0> error: streaming stopped, reason error (-5)
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Internal data stream error.
Additional debug info:
../libs/gst/base/gstbasesrc.c(3127): gst_base_src_loop (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
streaming stopped, reason error (-5)
0:00:34.597679046 239311   0x5566eee060 WARN                  mppdec gstmppdec.c:963:gst_mpp_dec_loop:<mppjpegdec0> no matched frame

Update boot_merger and trust_merger sources

The boot_merger and trust_merger source code in this repo is significantly older than the binaries, and doesn't support RK35xx. This makes self-hosted builds for these platforms impossible, requiring cross-compilation on an x86 machine instead.

This is a follow-up to #4.

Gstreamer HEVC 10Bit issue on RK3588

Hi @JeffyCN ,
I cannot decode hevc-10bit.mkv on RK3588, while ffmpeg can decode just fine.

I have:
#define HAVE_NV12_10LE40 1

Do you need any additional info?

VP8 encoding results in iommu page fault

mpi_enc_test -i avdec.yuv -o out.enc -w 640 -h 360 -f 4 -t 9 -n 2

Frame 0:

[   42.213800] rk_iommu ff650800.iommu: Page fault at 0x0000000004382010 of type write
[   42.214509] rk_iommu ff650800.iommu: iova = 0x0000000004382010: dte_index: 0x10 pte_index: 0x382 page_offset: 0x10
[   42.215438] rk_iommu ff650800.iommu: mmu_dte_addr: 0x000000003da7c000 dte@0x000000003da7c040: 0x000000 valid: 0 pte@0x0000000000000000: 0x000000 valid: 0 page@0x0000000000000000 flags: 0x0
[   42.216918] rk-vcodec ff650000.vpu_service: vcodec, fault addr 0x04382010 status 6b

[   42.248374] rk-vcodec ff650000.vpu_service: reg[44] 04382013

Frame 1:

[   42.349926] rk_iommu ff650800.iommu: Page fault at 0x0000000000000010 of type write
[   42.350615] rk_iommu ff650800.iommu: iova = 0x0000000000000010: dte_index: 0x0 pte_index: 0x0 page_offset: 0x10
[   42.351503] rk_iommu ff650800.iommu: mmu_dte_addr: 0x000000003da7c000 dte@0x000000003da7c000: 0x000000 valid: 0 pte@0x0000000000000000: 0x000000 valid: 0 page@0x0000000000000000 flags: 0x0
[   42.352966] rk-vcodec ff650000.vpu_service: vcodec, fault addr 0x00000010 status 6b

[   42.401597] rk-vcodec ff650000.vpu_service: reg[80] 00000010

I'm trying this on rk3399. The addresses are set in: mpp/hal/vpu/vp8e/hal_vp8e_vepu2_v2.c, static MPP_RET vp8e_vpu_frame_start(void *hal):

regs->sw44.base_partition1 =  hw_cfg->partition_Base[0];

regs->sw80.base_mv_write =  hw_cfg->mv_output_base;

and are never mapped by iommu, hence the page fault.

gstreamer hangs after a while playing hevc 10bit and av1 10bit

Hi @JeffyCN ,

I am trying to decode hevc 10-bit and av1 10-bit, it works for a while and then gives an internal error, exactly at the same offset anytime i play the file.

You can reproduce the error with:

HEVC 10bit:

gst-launch-1.0 filesrc location=/apps/Videos/jellyfish-20-mbps-hd-hevc-10bit.mkv ! matroskademux ! h265parse ! mppvideodec ! videoconvert ! video/x-raw,format=NV12_10LE40 ! appsink
Setting pipeline to PAUSED ...
Pipeline is PREROLLING ...
Pipeline is PREROLLED ...
Prerolled, waiting for async message to finish...
Setting pipeline to PLAYING ...
Redistribute latency...
New clock: GstSystemClock
ERROR: from element /GstPipeline:pipeline0/GstMatroskaDemux:matroskademux0: Internal data stream error.
Additional debug info:
../gst/matroska/matroska-demux.c(6076): gst_matroska_demux_loop (): /GstPipeline:pipeline0/GstMatroskaDemux:matroskademux0:
streaming stopped, reason error (-5)
Execution ended after 0:00:19.272551234
Setting pipeline to NULL ...
Freeing pipeline ...

verbose:

gst-launch-1.0 filesrc location=/apps/Videos/jellyfish-20-mbps-hd-hevc-10bit.mkv ! matroskademux ! h265parse ! mppvideodec ! videoconvert ! video/x-raw,format=NV12_10LE40 ! appsink -v
Setting pipeline to PAUSED ...
Pipeline is PREROLLING ...
/GstPipeline:pipeline0/GstH265Parse:h265parse0.GstPad:src: caps = video/x-h265, level=(string)4, tier=(string)high, profile=(string)main-10, codec_data=(buffer)01222000000090000000000078f000fcfdfafa00000f03200001001840010c01ffff222000000300900000030000030078999809210001002a420101222000000300900000030000030078a003c08010e4d96666924caf0101000003006400000bb50822000100074401c172b46240, stream-format=(string)hvc1, alignment=(string)au, width=(int)1920, height=(int)1080, framerate=(fraction)30000/1001, chroma-format=(string)4:2:0, bit-depth-luma=(uint)10, bit-depth-chroma=(uint)10, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1
/GstPipeline:pipeline0/GstMppVideoDec:mppvideodec0.GstPad:sink: caps = video/x-h265, level=(string)4, tier=(string)high, profile=(string)main-10, codec_data=(buffer)01222000000090000000000078f000fcfdfafa00000f03200001001840010c01ffff222000000300900000030000030078999809210001002a420101222000000300900000030000030078a003c08010e4d96666924caf0101000003006400000bb50822000100074401c172b46240, stream-format=(string)hvc1, alignment=(string)au, width=(int)1920, height=(int)1080, framerate=(fraction)30000/1001, chroma-format=(string)4:2:0, bit-depth-luma=(uint)10, bit-depth-chroma=(uint)10, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1
/GstPipeline:pipeline0/GstH265Parse:h265parse0.GstPad:sink: caps = video/x-h265, level=(string)4, tier=(string)high, profile=(string)main-10, codec_data=(buffer)01222000000090000000000078f000fffdfafa00000f03a00001001840010c01ffff222000000300900000030000030078999809a10001002a420101222000000300900000030000030078a003c08010e4d96666924caf0101000003006400000bb508a2000100074401c172b46240, stream-format=(string)hvc1, alignment=(string)au, width=(int)1920, height=(int)1080, framerate=(fraction)30000/1001
/GstPipeline:pipeline0/GstH265Parse:h265parse0.GstPad:src: caps = video/x-h265, level=(string)4, tier=(string)high, profile=(string)main-10, codec_data=(buffer)01222000000090000000000078f000fcfdfafa00000f03200001001840010c01ffff222000000300900000030000030078999809210001002a420101222000000300900000030000030078a003c08010e4d96666924caf0101000003006400000bb50822000100074401c172b46240, stream-format=(string)hvc1, alignment=(string)au, width=(int)1920, height=(int)1080, framerate=(fraction)30000/1001, chroma-format=(string)4:2:0, bit-depth-luma=(uint)10, bit-depth-chroma=(uint)10, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1
/GstPipeline:pipeline0/GstMppVideoDec:mppvideodec0.GstPad:sink: caps = video/x-h265, level=(string)4, tier=(string)high, profile=(string)main-10, codec_data=(buffer)01222000000090000000000078f000fcfdfafa00000f03200001001840010c01ffff222000000300900000030000030078999809210001002a420101222000000300900000030000030078a003c08010e4d96666924caf0101000003006400000bb50822000100074401c172b46240, stream-format=(string)hvc1, alignment=(string)au, width=(int)1920, height=(int)1080, framerate=(fraction)30000/1001, chroma-format=(string)4:2:0, bit-depth-luma=(uint)10, bit-depth-chroma=(uint)10, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1
/GstPipeline:pipeline0/GstMppVideoDec:mppvideodec0.GstPad:src: caps = video/x-raw(memory:DMABuf), format=(string)NV12_10LE40, width=(int)1920, height=(int)1080, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30000/1001
/GstPipeline:pipeline0/GstVideoConvert:videoconvert0.GstPad:src: caps = video/x-raw(memory:DMABuf), format=(string)NV12_10LE40, width=(int)1920, height=(int)1080, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30000/1001
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw, format=(string)NV12_10LE40, width=(int)1920, height=(int)1080, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30000/1001
/GstPipeline:pipeline0/GstAppSink:appsink0.GstPad:sink: caps = video/x-raw, format=(string)NV12_10LE40, width=(int)1920, height=(int)1080, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30000/1001
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw(memory:DMABuf), format=(string)NV12_10LE40, width=(int)1920, height=(int)1080, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30000/1001
/GstPipeline:pipeline0/GstVideoConvert:videoconvert0.GstPad:sink: caps = video/x-raw(memory:DMABuf), format=(string)NV12_10LE40, width=(int)1920, height=(int)1080, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30000/1001
Pipeline is PREROLLED ...
Prerolled, waiting for async message to finish...
Setting pipeline to PLAYING ...
Redistribute latency...
New clock: GstSystemClock
ERROR: from element /GstPipeline:pipeline0/GstMatroskaDemux:matroskademux0: Internal data stream error.
Additional debug info:
../gst/matroska/matroska-demux.c(6076): gst_matroska_demux_loop (): /GstPipeline:pipeline0/GstMatroskaDemux:matroskademux0:
streaming stopped, reason error (-5)
Execution ended after 0:00:19.268115245
Setting pipeline to NULL ...
Freeing pipeline ...

AV1 10bit:

gst-launch-1.0 filesrc location=/apps/Videos/av1-10bit-1080p-sample.mkv ! matroskademux ! av1parse ! mppvideodec ! videoconvert ! video/x-raw,format=NV12_10LE40 ! appsink
Setting pipeline to PAUSED ...
Pipeline is PREROLLING ...
Pipeline is PREROLLED ...
Prerolled, waiting for async message to finish...
Setting pipeline to PLAYING ...
Redistribute latency...
New clock: GstSystemClock
ERROR: from element /GstPipeline:pipeline0/GstMatroskaDemux:matroskademux0: Internal data stream error.
Additional debug info:
../gst/matroska/matroska-demux.c(6076): gst_matroska_demux_loop (): /GstPipeline:pipeline0/GstMatroskaDemux:matroskademux0:
streaming stopped, reason error (-5)
Execution ended after 0:00:23.360245123
Setting pipeline to NULL ...
Freeing pipeline ...

Bug in the alpha decoder

Hi, sorry to bother you, but we fixed a bug in upstream gstreamer that has been introduce in your gstreamer-rockchip repo too. You'll find the details here: https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/6452

In short, we don't cast the value pass as vararg to "max-size-time" property, meaning we pass 32bit instead of 64.

gstreamer-rkisp plugin doesn't buid

Hi Jeffy,
to get access to ov13850 is gst plugin necessary. in some documentation like hier: http://opensource.rock-chips.com/wiki_Rockchip-isp1 it is named as "rkcamsrc" on others it is named as "rkisp". But no one of them was build from meta-rockchip\recipes-multimedia\gstreamer-rockchip.

Any chance for yocto layer for gstreamer-rockchip?

Thank you for maintaining this repo.
What is the easiest way to get/make yocto layers for gstreamer-rockchip?

[Request] aarch64 versions of the rkbin/tools binaries

Right now, it's not possible to compile uboot and create the signed uboot binaries (idbloader.img, idblock.bin and trust.img) on an aarch64 device, like the Quartz64.

So it's not possible to build the software on the device it's suppose to run on.
And that's because all the binaries in rkbin/tools/ are x86_64, so they are not able to be executed on aarch64 based hardware.

I would like to request aarch64 versions of those binaries. They could even just be placed in an rkbin/tools/aarch64 folder or something like that.

Thanks for reading this request.

nvr buildroot

怎样使用这个buildroot在nvr sdk里

Fetch error during compilation

I'm only getting an error when pulling from this address. Any idea about the reason for this?

Initialising tasks: 100% |#######################################################| Time: 0:00:09
Sstate summary: Wanted 4778 Local 0 Mirrors 0 Missed 4778 Current 681 (0% match, 12% complete)
NOTE: Executing Tasks
WARNING: rockchip-libmali-1.0-r0 do_fetch: Failed to fetch URL git://github.com/JeffyCN/mirrors.git;protocol=https;branch=libmali;, attempting MIRRORS if available
ERROR: rockchip-libmali-1.0-r0 do_fetch: Fetcher failure: Unable to find revision 71900e3e0c47f6191b44be9ecd37ffc194af6687 in branch libmali even from upstream
ERROR: rockchip-libmali-1.0-r0 do_fetch: Bitbake Fetcher Error: FetchError('Unable to fetch URL from any source.', 'git://github.com/JeffyCN/mirrors.git;protocol=https;branch=libmali;')
ERROR: rockchip-librga-1.0-r0 do_unpack: Bitbake Fetcher Error: UnpackError('No up to date source found: clone directory not available or not up to date: /media/tunahan/f1cceee6-ac24-4956-9e80-7ce648ac31e4/yoctoproject-kirkstone/build/downloads/git2/github.com.JeffyCN.mirrors.git; shallow clone not enabled', 'git://github.com/JeffyCN/mirrors.git;protocol=https;branch=linux-rga;')
ERROR: Logfile of failure stored in: /media/tunahan/f1cceee6-ac24-4956-9e80-7ce648ac31e4/yoctoproject-kirkstone/build/tmp/work/mepsan_pcr172-mepos-linux-gnueabi/rockchip-libmali/1.0-r0/temp/log.do_fetch.22862
ERROR: Logfile of failure stored in: /media/tunahan/f1cceee6-ac24-4956-9e80-7ce648ac31e4/yoctoproject-kirkstone/build/tmp/work/armv7vet2hf-neon-mepos-linux-gnueabi/rockchip-librga/1.0-r0/temp/log.do_unpack.22884
ERROR: Task (/media/tunahan/f1cceee6-ac24-4956-9e80-7ce648ac31e4/yoctoproject-kirkstone/meta-rockchip/recipes-graphics/rockchip-libmali/rockchip-libmali.bb:do_fetch) failed with exit code '1'
ERROR: Task (/media/tunahan/f1cceee6-ac24-4956-9e80-7ce648ac31e4/yoctoproject-kirkstone/meta-rockchip/recipes-graphics/rockchip-librga/rockchip-librga.bb:do_unpack) failed with exit code '1'
NOTE: Tasks Summary: Attempted 2585 tasks of which 2583 didn't need to be rerun and 2 failed.

Summary: 2 tasks failed:
  /media/tunahan/f1cceee6-ac24-4956-9e80-7ce648ac31e4/yoctoproject-kirkstone/meta-rockchip/recipes-graphics/rockchip-libmali/rockchip-libmali.bb:do_fetch
  /media/tunahan/f1cceee6-ac24-4956-9e80-7ce648ac31e4/yoctoproject-kirkstone/meta-rockchip/recipes-graphics/rockchip-librga/rockchip-librga.bb:do_unpack
Summary: There was 1 WARNING message.
Summary: There were 3 ERROR messages, returning a non-zero exit code.

log files:
log.do_fetch.22862.txt
log.do_unpack.22884.txt

gstreamer NV24 support

Hi @JeffyCN ,

Is there support for NV24 and which version? Can you share a pipeline?

RgaBlit(1465) RGA_BLIT fail: Invalid argument

Hi,
the pipeline runs for few seconds and it then fails with RGA_BLIT fail: Invalid argument.

(base) root@firefly:~# env|grep GST
GST_V4L2_PREFERRED_FOURCC=NV12:YU12:NV16:YUY2
GST_VIDEO_CONVERT_PREFERRED_FORMAT=NV12:NV16:I420:YUY2
GST_MPP_NO_RGA=0
GST_GL_PLATFORM=egl
GST_V4L2_USE_LIBV4L2=1
GST_INSPECT_NO_COLORS=1
GST_DEBUG_NO_COLOR=1
GST_V4L2SRC_DEFAULT_DEVICE=/dev/video-camera0
GST_V4L2SRC_RK_DEVICES=_mainpath:_selfpath:_bypass:_scale
GST_GL_API=gles2
GST_V4L2SRC_MAX_RESOLUTION=3840x2160
GST_MPP_VIDEODEC_DEFAULT_ARM_AFBC=1
(base) root@firefly:~/gst-rtsp-server/examples# gst-launch-1.0 --gst-debug=4 v4l2src device=/dev/video12 ! image/jpeg,width=3840,height=2160,framerate=10/1 ! mppjpegdec format=RGB dma-feature=0 max-errors=-1 ! mpph264enc ! rtph264pay name=pay0 pt=96 ! fpsdisplaysink video-sink="fakesink" text-overlay=false -ve
0:00:00.000794793 143596   0x55702b92c0 INFO                GST_INIT gstmessage.c:129:_priv_gst_message_initialize: init messages
0:00:00.001932294 143596   0x55702b92c0 INFO                GST_INIT gstcontext.c:85:_priv_gst_context_initialize: init contexts
0:00:00.002509212 143596   0x55702b92c0 INFO      GST_PLUGIN_LOADING gstplugin.c:325:_priv_gst_plugin_initialize: registering 0 static plugins
0:00:00.002786879 143596   0x55702b92c0 INFO      GST_PLUGIN_LOADING gstplugin.c:233:gst_plugin_register_static: registered static plugin "staticelements"
0:00:00.002825379 143596   0x55702b92c0 INFO      GST_PLUGIN_LOADING gstplugin.c:235:gst_plugin_register_static: added static plugin "staticelements", result: 1
0:00:00.002870588 143596   0x55702b92c0 INFO            GST_REGISTRY gstregistry.c:1755:ensure_current_registry: reading registry cache: /root/.cache/gstreamer-1.0/registry.aarch64.bin
0:00:00.036123349 143596   0x55702b92c0 INFO            GST_REGISTRY gstregistrybinary.c:666:priv_gst_registry_binary_read_cache: loaded /root/.cache/gstreamer-1.0/registry.aarch64.bin in 0.033184 seconds
0:00:00.036373891 143596   0x55702b92c0 INFO            GST_REGISTRY gstregistry.c:1614:scan_and_update_registry: Validating plugins from registry cache: /root/.cache/gstreamer-1.0/registry.aarch64.bin
0:00:00.039693938 143596   0x55702b92c0 INFO            GST_REGISTRY gstregistry.c:1713:scan_and_update_registry: Registry cache has not changed
0:00:00.039722230 143596   0x55702b92c0 INFO            GST_REGISTRY gstregistry.c:1790:ensure_current_registry: registry reading and updating done, result = 1
0:00:00.039734771 143596   0x55702b92c0 INFO                GST_INIT gst.c:806:init_post: GLib runtime version: 2.66.8
0:00:00.039752563 143596   0x55702b92c0 INFO                GST_INIT gst.c:808:init_post: GLib headers version: 2.66.8
0:00:00.039760146 143596   0x55702b92c0 INFO                GST_INIT gst.c:810:init_post: initialized GStreamer successfully
0:00:00.039833646 143596   0x55702b92c0 INFO            GST_PIPELINE gstparse.c:344:gst_parse_launch_full: parsing pipeline description 'v4l2src device=/dev/video12 ! image/jpeg,width=3840,height=2160,framerate=10/1 ! mppjpegdec format=RGB dma-feature=0 max-errors=-1 ! mpph264enc ! rtph264pay name=pay0 pt=96 ! fpsdisplaysink video-sink=fakesink text-overlay=false '
0:00:00.198072648 143596   0x55702b92c0 INFO      GST_PLUGIN_LOADING gstplugin.c:915:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstvideo4linux2.so" loaded
0:00:00.198424982 143596   0x55702b92c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "v4l2src"
0:00:00.207435621 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseSrc@0x55705401e0> adding pad 'src'
0:00:00.214534799 143596   0x55702b92c0 INFO      GST_PLUGIN_LOADING gstplugin.c:915:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstrockchipmpp.so" loaded
0:00:00.214588466 143596   0x55702b92c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "mppjpegdec"
0:00:00.214669258 143596   0x55702b92c0 WARN                     mpp gstmpp.c:121:gst_mpp_use_rga: RGA enabled
0:00:00.215069717 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstVideoDecoder@0x557053f9a0> adding pad 'sink'
0:00:00.215207384 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstVideoDecoder@0x557053f9a0> adding pad 'src'
0:00:00.215501093 143596   0x55702b92c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "mpph264enc"
0:00:00.215925468 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstVideoEncoder@0x5570552910> adding pad 'sink'
0:00:00.215978260 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstVideoEncoder@0x5570552910> adding pad 'src'
0:00:00.220366975 143596   0x55702b92c0 INFO      GST_PLUGIN_LOADING gstplugin.c:915:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstrtp.so" loaded
0:00:00.220409267 143596   0x55702b92c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "rtph264pay"
0:00:00.220690726 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstRTPBasePayload@0x55705620a0> adding pad 'src'
0:00:00.220745559 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstRTPBasePayload@0x55705620a0> adding pad 'sink'
0:00:00.225891443 143596   0x55702b92c0 INFO      GST_PLUGIN_LOADING gstplugin.c:915:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstdebugutilsbad.so" loaded
0:00:00.225931984 143596   0x55702b92c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "fpsdisplaysink"
0:00:00.226210235 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstFPSDisplaySink@0x557056a0d0> adding pad 'sink'
0:00:00.226283735 143596   0x55702b92c0 INFO            GST_PIPELINE gstparse.c:344:gst_parse_launch_full: parsing pipeline description 'fakesink'
0:00:00.227565029 143596   0x55702b92c0 INFO      GST_PLUGIN_LOADING gstplugin.c:915:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstcoreelements.so" loaded
0:00:00.227611404 143596   0x55702b92c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "fakesink"
0:00:00.227867487 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseSink@0x55705752b0> adding pad 'sink'
0:00:00.228007196 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:1009:gst_element_get_static_pad: found pad fakesink0:sink
0:00:00.228073404 143596   0x55702b92c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "pipeline"
0:00:00.228338821 143596   0x55702b92c0 INFO            GST_PIPELINE gst/parse/grammar.y:689:gst_parse_perform_link: linking some pad of GstV4l2Src named v4l2src0 to some pad of GstMppJpegDec named mppjpegdec0 (0/0) with caps "image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)10/1"
0:00:00.228377613 143596   0x55702b92c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "capsfilter"
0:00:00.228561655 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseTransform@0x55705782a0> adding pad 'sink'
0:00:00.228619989 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseTransform@0x55705782a0> adding pad 'src'
0:00:00.228664322 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2115:gst_bin_get_state_func:<pipeline0> getting state
0:00:00.228725864 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<capsfilter0> completed state change to NULL
0:00:00.228757655 143596   0x55702b92c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.228804030 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstutils.c:1816:gst_element_link_pads_full: trying to link element v4l2src0:(any) to element capsfilter0:sink
0:00:00.228833489 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:1009:gst_element_get_static_pad: found pad capsfilter0:sink
0:00:00.228854197 143596   0x55702b92c0 INFO                GST_PADS gstutils.c:1632:prepare_link_maybe_ghosting: v4l2src0 and capsfilter0 in same bin, no need for ghost pads
0:00:00.228895031 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:2404:gst_pad_link_prepare: trying to link v4l2src0:src and capsfilter0:sink
0:00:00.228951906 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<capsfilter0:src> pad has no peer
0:00:00.229011989 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:2612:gst_pad_link_full: linked v4l2src0:src and capsfilter0:sink, successful
0:00:00.229039114 143596   0x55702b92c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.229055448 143596   0x55702b92c0 INFO               GST_EVENT gstpad.c:5925:gst_pad_send_event_unchecked:<v4l2src0:src> Received event on flushing pad. Discarding
0:00:00.229105323 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstutils.c:1816:gst_element_link_pads_full: trying to link element capsfilter0:src to element mppjpegdec0:(any)
0:00:00.229136823 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:1009:gst_element_get_static_pad: found pad capsfilter0:src
0:00:00.229175031 143596   0x55702b92c0 INFO                GST_PADS gstutils.c:1079:gst_pad_check_link: trying to link capsfilter0:src and mppjpegdec0:sink
0:00:00.229267781 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<mppjpegdec0:src> pad has no peer
0:00:00.229374240 143596   0x55702b92c0 INFO                GST_PADS gstutils.c:1632:prepare_link_maybe_ghosting: capsfilter0 and mppjpegdec0 in same bin, no need for ghost pads
0:00:00.229417406 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:2404:gst_pad_link_prepare: trying to link capsfilter0:src and mppjpegdec0:sink
0:00:00.229482448 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<mppjpegdec0:src> pad has no peer
0:00:00.229553907 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:2612:gst_pad_link_full: linked capsfilter0:src and mppjpegdec0:sink, successful
0:00:00.229582782 143596   0x55702b92c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.229612240 143596   0x55702b92c0 INFO               GST_EVENT gstpad.c:5925:gst_pad_send_event_unchecked:<capsfilter0:src> Received event on flushing pad. Discarding
0:00:00.229667657 143596   0x55702b92c0 INFO            GST_PIPELINE gst/parse/grammar.y:689:gst_parse_perform_link: linking some pad of GstMppJpegDec named mppjpegdec0 to some pad of GstMppH264Enc named mpph264enc0 (0/0) with caps "(NULL)"
0:00:00.229702074 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstutils.c:1816:gst_element_link_pads_full: trying to link element mppjpegdec0:(any) to element mpph264enc0:(any)
0:00:00.229742324 143596   0x55702b92c0 INFO                GST_PADS gstutils.c:1079:gst_pad_check_link: trying to link mppjpegdec0:src and mpph264enc0:sink
0:00:00.229790157 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<mpph264enc0:src> pad has no peer
0:00:00.229875907 143596   0x55702b92c0 INFO                GST_PADS gstutils.c:1632:prepare_link_maybe_ghosting: mppjpegdec0 and mpph264enc0 in same bin, no need for ghost pads
0:00:00.229920241 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:2404:gst_pad_link_prepare: trying to link mppjpegdec0:src and mpph264enc0:sink
0:00:00.229959032 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<mpph264enc0:src> pad has no peer
0:00:00.230030782 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:2612:gst_pad_link_full: linked mppjpegdec0:src and mpph264enc0:sink, successful
0:00:00.230058199 143596   0x55702b92c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.230089408 143596   0x55702b92c0 INFO               GST_EVENT gstpad.c:5925:gst_pad_send_event_unchecked:<mppjpegdec0:src> Received event on flushing pad. Discarding
0:00:00.230139866 143596   0x55702b92c0 INFO            GST_PIPELINE gst/parse/grammar.y:689:gst_parse_perform_link: linking some pad of GstMppH264Enc named mpph264enc0 to some pad of GstRtpH264Pay named pay0 (0/0) with caps "(NULL)"
0:00:00.230173699 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstutils.c:1816:gst_element_link_pads_full: trying to link element mpph264enc0:(any) to element pay0:(any)
0:00:00.230198783 143596   0x55702b92c0 INFO                GST_PADS gstutils.c:1079:gst_pad_check_link: trying to link mpph264enc0:src and pay0:sink
0:00:00.230238449 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<pay0:src> pad has no peer
0:00:00.230291533 143596   0x55702b92c0 INFO                GST_PADS gstutils.c:1632:prepare_link_maybe_ghosting: mpph264enc0 and pay0 in same bin, no need for ghost pads
0:00:00.230331491 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:2404:gst_pad_link_prepare: trying to link mpph264enc0:src and pay0:sink
0:00:00.230368533 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<pay0:src> pad has no peer
0:00:00.230416075 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:2612:gst_pad_link_full: linked mpph264enc0:src and pay0:sink, successful
0:00:00.230441741 143596   0x55702b92c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.230469741 143596   0x55702b92c0 INFO               GST_EVENT gstpad.c:5925:gst_pad_send_event_unchecked:<mpph264enc0:src> Received event on flushing pad. Discarding
0:00:00.230518450 143596   0x55702b92c0 INFO            GST_PIPELINE gst/parse/grammar.y:689:gst_parse_perform_link: linking some pad of GstRtpH264Pay named pay0 to some pad of GstFPSDisplaySink named fpsdisplaysink0 (0/0) with caps "(NULL)"
0:00:00.230553450 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstutils.c:1816:gst_element_link_pads_full: trying to link element pay0:(any) to element fpsdisplaysink0:(any)
0:00:00.230577950 143596   0x55702b92c0 INFO                GST_PADS gstutils.c:1079:gst_pad_check_link: trying to link pay0:src and fpsdisplaysink0:sink
0:00:00.230629575 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<sink:proxypad0> pad has no peer
0:00:00.230667200 143596   0x55702b92c0 INFO                GST_PADS gstutils.c:1632:prepare_link_maybe_ghosting: pay0 and fpsdisplaysink0 in same bin, no need for ghost pads
0:00:00.230706575 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:2404:gst_pad_link_prepare: trying to link pay0:src and fpsdisplaysink0:sink
0:00:00.230747409 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<sink:proxypad0> pad has no peer
0:00:00.230787659 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:2612:gst_pad_link_full: linked pay0:src and fpsdisplaysink0:sink, successful
0:00:00.230814492 143596   0x55702b92c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.230842492 143596   0x55702b92c0 INFO               GST_EVENT gstpad.c:5925:gst_pad_send_event_unchecked:<pay0:src> Received event on flushing pad. Discarding
Setting pipeline to PAUSED ...
0:00:00.231043451 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<fpsdisplaysink0> current NULL pending VOID_PENDING, desired next READY
0:00:00.231082534 143596   0x55702b92c0 INFO        GST_ELEMENT_PADS gstelement.c:1009:gst_element_get_static_pad: found pad fakesink0:sink
0:00:00.231118701 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:2404:gst_pad_link_prepare: trying to link sink:proxypad0 and fakesink0:sink
0:00:00.231151951 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:2612:gst_pad_link_full: linked sink:proxypad0 and fakesink0:sink, successful
0:00:00.231176159 143596   0x55702b92c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.231232451 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<fakesink0> current NULL pending VOID_PENDING, desired next READY
0:00:00.231269493 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<fakesink0> completed state change to READY
0:00:00.231305368 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<fakesink0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.231369826 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<fpsdisplaysink0> child 'fakesink0' changed state to 2(READY) successfully
0:00:00.231408910 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<fpsdisplaysink0> completed state change to READY
0:00:00.231440993 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<fpsdisplaysink0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.231482701 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'fpsdisplaysink0' changed state to 2(READY) successfully
0:00:00.231520618 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<pay0> current NULL pending VOID_PENDING, desired next READY
0:00:00.231556202 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<pay0> completed state change to READY
0:00:00.231614827 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<pay0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.231654785 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'pay0' changed state to 2(READY) successfully
0:00:00.231691535 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<mpph264enc0> current NULL pending VOID_PENDING, desired next READY
0:00:00.231724493 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<mpph264enc0> completed state change to READY
0:00:00.231754827 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<mpph264enc0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.231793327 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'mpph264enc0' changed state to 2(READY) successfully
0:00:00.231829202 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<mppjpegdec0> current NULL pending VOID_PENDING, desired next READY
0:00:00.231861577 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<mppjpegdec0> completed state change to READY
0:00:00.231891619 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<mppjpegdec0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.231928369 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'mppjpegdec0' changed state to 2(READY) successfully
0:00:00.231963077 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<capsfilter0> current NULL pending VOID_PENDING, desired next READY
0:00:00.231995744 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<capsfilter0> completed state change to READY
0:00:00.232025202 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<capsfilter0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.232064286 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'capsfilter0' changed state to 2(READY) successfully
0:00:00.232098702 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<v4l2src0> current NULL pending VOID_PENDING, desired next READY
0:00:00.239858215 143596   0x55702b92c0 INFO                    v4l2 v4l2_calls.c:588:gst_v4l2_open:<v4l2src0:src> Opened device 'Hama C-900 Pro UHD: Hama C-900 ' (/dev/video12) successfully
0:00:00.239936673 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<v4l2src0> completed state change to READY
0:00:00.239960590 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<v4l2src0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.240032340 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'v4l2src0' changed state to 2(READY) successfully
0:00:00.240078132 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2741:gst_element_continue_state:<pipeline0> committing state from NULL to READY, pending PAUSED, next PAUSED
0:00:00.240113715 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<pipeline0> notifying about state-changed NULL to READY (PAUSED pending)
0:00:00.240221340 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2749:gst_element_continue_state:<pipeline0> continue state change READY to PAUSED, final PAUSED
0:00:00.240292799 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<fpsdisplaysink0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.240398382 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<fakesink0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.240473049 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2984:gst_bin_change_state_func:<fpsdisplaysink0> child 'fakesink0' is changing state asynchronously to PAUSED
0:00:00.240529049 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2984:gst_bin_change_state_func:<pipeline0> child 'fpsdisplaysink0' is changing state asynchronously to PAUSED
0:00:00.240573091 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<pay0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.240695299 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<pay0> completed state change to PAUSED
0:00:00.240736424 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<pay0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:00.240797966 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'pay0' changed state to 3(PAUSED) successfully
0:00:00.240840550 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<mpph264enc0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.242004301 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<mpph264enc0> completed state change to PAUSED
0:00:00.242051260 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<mpph264enc0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:00.242117177 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'mpph264enc0' changed state to 3(PAUSED) successfully
0:00:00.242161510 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<mppjpegdec0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.242459511 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<mppjpegdec0> completed state change to PAUSED
0:00:00.242519886 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<mppjpegdec0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:00.242612344 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'mppjpegdec0' changed state to 3(PAUSED) successfully
0:00:00.242678261 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<capsfilter0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.242731636 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<capsfilter0> completed state change to PAUSED
0:00:00.242765469 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<capsfilter0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:00.242827303 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'capsfilter0' changed state to 3(PAUSED) successfully
0:00:00.242861720 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<v4l2src0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.242947178 143596   0x55702b92c0 INFO                 basesrc gstbasesrc.c:1430:gst_base_src_do_seek:<v4l2src0> seeking: time segment start=0:00:00.000000000, offset=0:00:00.000000000, stop=99:99:99.999999999, rate=1.000000, applied_rate=1.000000, flags=0x00, time=0:00:00.000000000, base=0:00:00.000000000, position 0:00:00.000000000, duration 99:99:99.999999999
0:00:00.243077262 143596   0x55702b92c0 INFO                    task gsttask.c:516:gst_task_set_lock: setting stream lock 0x5570542150 on task 0x55705533b0
0:00:00.243133845 143596   0x55702b92c0 INFO                GST_PADS gstpad.c:6270:gst_pad_start_task:<v4l2src0:src> created task 0x55705533b0
0:00:00.243370095 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<v4l2src0> completed state change to PAUSED
0:00:00.243448554 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<v4l2src0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:00.243534596 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:3020:gst_bin_change_state_func:<pipeline0> child 'v4l2src0' changed state to 3(PAUSED) successfully without preroll
0:00:00.243618012 143596   0x55702b92c0 INFO                pipeline gstpipeline.c:529:gst_pipeline_change_state:<pipeline0> pipeline is live
0:00:00.243680721 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<pipeline0> completed state change to PAUSED
0:00:00.243772596 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<pipeline0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
Pipeline is live and does not need PREROLL ...
0:00:00.243971513 143596   0x5570539760 INFO        GST_ELEMENT_PADS gstelement.c:1006:gst_element_get_static_pad: no such pad 'sink' in element "v4l2src0"
0:00:00.244268430 143596   0x5570539760 INFO                    v4l2 gstv4l2object.c:1270:gst_v4l2_object_fill_format_list:<v4l2src0:src> got 2 format(s):
0:00:00.244327055 143596   0x5570539760 INFO                    v4l2 gstv4l2object.c:1274:gst_v4l2_object_fill_format_list:<v4l2src0:src>   YUYV
0:00:00.244377222 143596   0x5570539760 INFO                    v4l2 gstv4l2object.c:1274:gst_v4l2_object_fill_format_list:<v4l2src0:src>   MJPG
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = true
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
0:00:00.245143431 143596   0x55702b92c0 INFO               GST_EVENT gstevent.c:1480:gst_event_new_latency: creating latency event 0:00:00.000000000
0:00:00.245288682 143596   0x55702b92c0 INFO                     bin gstbin.c:2808:gst_bin_do_latency_func:<pipeline0> configured latency of 0:00:00.000000000
0:00:00.245407390 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<fpsdisplaysink0> current READY pending PAUSED, desired next PLAYING
0:00:00.245482349 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2984:gst_bin_change_state_func:<pipeline0> child 'fpsdisplaysink0' is changing state asynchronously to PLAYING
0:00:00.245561390 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<pay0> current PAUSED pending VOID_PENDING, desired next PLAYING
0:00:00.245601932 143596   0x5570539760 INFO                    v4l2 gstv4l2object.c:4560:gst_v4l2_object_probe_caps:<v4l2src0:src> probed caps: video/x-raw, format=(string)YUY2, width=(int)3840, height=(int)2160, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)1/1; video/x-raw, format=(string)YUY2, width=(int)2560, height=(int)1440, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)1/1; video/x-raw, format=(string)YUY2, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)5/1; video/x-raw, format=(string)YUY2, width=(int)1600, height=(int)896, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)5/1; video/x-raw, format=(string)YUY2, width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)10/1; video/x-raw, format=(string)YUY2, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)15/1; video/x-raw, format=(string)YUY2, width=(int)800, height=(int)600, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)15/1; video/x-raw, format=(string)YUY2, width=(int)800, height=(int)480, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)25/1; video/x-raw, format=(string)YUY2, width=(int)640, height=(int)480, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1; video/x-raw, format=(string)YUY2, width=(int)640, height=(int)360, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1; video/x-raw, format=(string)YUY2, width=(int)424, height=(int)240, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1; video/x-raw, format=(string)YUY2, width=(int)352, height=(int)288, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1; image/jpeg, width=(int)3840, height=(int)2160, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction){ 30/1, 25/1, 20/1, 15/1, 10/1, 5/1 }; image/jpeg, width=(int)2560, height=(int)1440, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction){ 30/1, 25/1, 20/1, 15/1, 10/1, 5/1 }; image/jpeg, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction){ 60/1, 30/1, 25/1, 20/1, 15/1, 10/1 }; image/jpeg, width=(int)1600, height=(int)896, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction){ 30/1, 25/1, 20/1, 15/1, 10/1, 5/1 }; image/jpeg, width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction){ 30/1, 25/1, 20/1, 15/1, 10/1, 5/1 }; image/jpeg, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction){ 30/1, 25/1, 20/1, 15/1, 10/1, 5/1 }; image/jpeg, width=(int)800, height=(int)600, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction){ 30/1, 25/1, 20/1, 15/1, 10/1, 5/1 }; image/jpeg, width=(int)800, height=(int)480, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction){ 30/1, 25/1, 20/1, 15/1, 10/1, 5/1 }; image/jpeg, width=(int)640, height=(int)480, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction){ 30/1, 25/1, 20/1, 15/1, 10/1, 5/1 }; image/jpeg, width=(int)640, height=(int)360, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction){ 30/1, 25/1, 20/1, 15/1, 10/1, 5/1 }; image/jpeg, width=(int)424, height=(int)240, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction){ 30/1, 25/1, 20/1, 15/1, 10/1, 5/1 }; image/jpeg, width=(int)352, height=(int)288, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction){ 30/1, 25/1, 20/1, 15/1, 10/1, 5/1 }
0:00:00.245630516 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<pay0> completed state change to PLAYING
0:00:00.245867058 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<pay0> notifying about state-changed PAUSED to PLAYING (VOID_PENDING pending)
0:00:00.245963891 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'pay0' changed state to 4(PLAYING) successfully
0:00:00.246050808 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<mpph264enc0> current PAUSED pending VOID_PENDING, desired next PLAYING
0:00:00.246124600 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<mpph264enc0> completed state change to PLAYING
0:00:00.246166600 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<mpph264enc0> notifying about state-changed PAUSED to PLAYING (VOID_PENDING pending)
0:00:00.246250308 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'mpph264enc0' changed state to 4(PLAYING) successfully
0:00:00.246334600 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<mppjpegdec0> current PAUSED pending VOID_PENDING, desired next PLAYING
0:00:00.246404017 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<mppjpegdec0> completed state change to PLAYING
0:00:00.246471684 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<mppjpegdec0> notifying about state-changed PAUSED to PLAYING (VOID_PENDING pending)
0:00:00.246556559 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'mppjpegdec0' changed state to 4(PLAYING) successfully
0:00:00.246639392 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<capsfilter0> current PAUSED pending VOID_PENDING, desired next PLAYING
0:00:00.246709684 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<capsfilter0> completed state change to PLAYING
0:00:00.246750809 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<capsfilter0> notifying about state-changed PAUSED to PLAYING (VOID_PENDING pending)
0:00:00.246834809 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'capsfilter0' changed state to 4(PLAYING) successfully
0:00:00.246922601 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<v4l2src0> completed state change to PLAYING
0:00:00.246992893 143596   0x55702b92c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<v4l2src0> notifying about state-changed PAUSED to PLAYING (VOID_PENDING pending)
0:00:00.247053560 143596   0x55702b92c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'v4l2src0' changed state to 4(PLAYING) successfully
New clock: GstSystemClock
0:00:00.276187731 143596   0x5570539760 INFO               GST_EVENT gstevent.c:847:gst_event_new_caps: creating caps event image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)10/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)10/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
0:00:00.277394941 143596   0x5570539760 INFO           basetransform gstbasetransform.c:1325:gst_base_transform_setcaps:<capsfilter0> reuse caps
0:00:00.277580441 143596   0x5570539760 INFO               GST_EVENT gstevent.c:847:gst_event_new_caps: creating caps event image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)10/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)10/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
0:00:00.280625738 143596   0x5570539760 INFO              mppjpegdec gstmppjpegdec.c:301:gst_mpp_jpeg_dec_set_format:<mppjpegdec0> convert from NV12 (3840x2160) to RGB (3840x2160)
0:00:00.280809488 143596   0x5570539760 WARN              video-info video-info.c:196:validate_colorimetry: color matrix RGB is only supported with RGB format, NV12 is not
0:00:00.280871905 143596   0x5570539760 WARN              video-info video-info.c:520:gst_video_info_from_caps: invalid colorimetry, using default
0:00:00.281015114 143596   0x5570539760 WARN              video-info video-info.c:734:gst_video_info_to_caps: invalid matrix 4 for RGB format, using RGB
0:00:00.281197406 143596   0x5570539760 INFO               GST_EVENT gstevent.c:847:gst_event_new_caps: creating caps event video/x-raw, format=(string)RGB, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)2:1:5:1, framerate=(fraction)10/1
/GstPipeline:pipeline0/GstMppJpegDec:mppjpegdec0.GstPad:src: caps = video/x-raw, format=(string)RGB, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)2:1:5:1, framerate=(fraction)10/1
0:00:00.281788906 143596   0x5570539760 WARN              video-info video-info.c:196:validate_colorimetry: color matrix RGB is only supported with RGB format, NV12 is not
0:00:00.281860073 143596   0x5570539760 WARN              video-info video-info.c:520:gst_video_info_from_caps: invalid colorimetry, using default
0:00:00.281934157 143596   0x5570539760 INFO                  mppenc gstmppenc.c:664:gst_mpp_enc_set_format:<mpph264enc0> converting to aligned NV12
0:00:00.282008532 143596   0x5570539760 INFO                  mppenc gstmppenc.c:671:gst_mpp_enc_set_format:<mpph264enc0> applying NV12 3840x2160 (3840x2160)
0:00:00.283241117 143596   0x5570539760 INFO               GST_EVENT gstevent.c:847:gst_event_new_caps: creating caps event video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)3840, height=(int)2160, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)10/1, interlace-mode=(string)progressive, colorimetry=(string)2:1:5:1, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
/GstPipeline:pipeline0/GstMppH264Enc:mpph264enc0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)3840, height=(int)2160, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)10/1, interlace-mode=(string)progressive, colorimetry=(string)2:1:5:1, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
/GstPipeline:pipeline0/GstRtpH264Pay:pay0.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)3840, height=(int)2160, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)10/1, interlace-mode=(string)progressive, colorimetry=(string)2:1:5:1, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
/GstPipeline:pipeline0/GstMppH264Enc:mpph264enc0.GstPad:sink: caps = video/x-raw, format=(string)RGB, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)2:1:5:1, framerate=(fraction)10/1
/GstPipeline:pipeline0/GstMppJpegDec:mppjpegdec0.GstPad:sink: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)10/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)10/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
0:00:00.388935619 143596   0x5570539760 INFO                    v4l2 gstv4l2object.c:3965:gst_v4l2_object_set_format_full:<v4l2src0:src> Set capture framerate to 10/1
0:00:00.389089036 143596   0x5570539760 INFO                    v4l2 gstv4l2object.c:3151:gst_v4l2_object_setup_pool:<v4l2src0:src> accessing buffers via mode 4
0:00:00.389869828 143596   0x5570539760 INFO          v4l2bufferpool gstv4l2bufferpool.c:557:gst_v4l2_buffer_pool_set_config:<v4l2src0:pool0:src> increasing minimum buffers to 2
0:00:00.389979204 143596   0x5570539760 INFO          v4l2bufferpool gstv4l2bufferpool.c:570:gst_v4l2_buffer_pool_set_config:<v4l2src0:pool0:src> reducing maximum buffers to 64
0:00:00.390217787 143596   0x5570539760 INFO          v4l2bufferpool gstv4l2bufferpool.c:570:gst_v4l2_buffer_pool_set_config:<v4l2src0:pool0:src> reducing maximum buffers to 64
0:00:00.414924993 143596   0x5570539760 WARN          v4l2bufferpool gstv4l2bufferpool.c:814:gst_v4l2_buffer_pool_start:<v4l2src0:pool0:src> Uncertain or not enough buffers, enabling copy threshold
0:00:00.930061813 143596   0x5570539760 INFO               GST_EVENT gstevent.c:927:gst_event_new_segment: creating segment event time segment start=0:00:00.000000000, offset=0:00:00.000000000, stop=99:99:99.999999999, rate=1.000000, applied_rate=1.000000, flags=0x00, time=0:00:00.000000000, base=0:00:00.000000000, position 0:00:00.000000000, duration 99:99:99.999999999
0:00:00.930276188 143596   0x5570539760 INFO                 basesrc gstbasesrc.c:3018:gst_base_src_loop:<v4l2src0> marking pending DISCONT
0:00:00.930636981 143596   0x5570539760 INFO                    task gsttask.c:516:gst_task_set_lock: setting stream lock 0x55705425f0 on task 0x7fb4024cb0
0:00:00.930745189 143596   0x5570539760 INFO                GST_PADS gstpad.c:6270:gst_pad_start_task:<mppjpegdec0:src> created task 0x7fb4024cb0
0:00:00.989862116 143596   0x5570539860 WARN                  mppdec gstmppdec.c:591:gst_mpp_dec_get_frame:<mppjpegdec0> MPP is not able to generate pts
rga_api version 1.8.1_[3]
0:00:01.002139053 143596   0x5570539860 INFO            videodecoder gstvideodecoder.c:3348:gst_video_decoder_clip_and_push_buf:<mppjpegdec0> First buffer since flush took 0:00:00.759912501 to produce
0:00:01.002309970 143596   0x5570539860 INFO                    task gsttask.c:516:gst_task_set_lock: setting stream lock 0x5570542a90 on task 0x7fb40303b0
0:00:01.002397178 143596   0x5570539860 INFO                GST_PADS gstpad.c:6270:gst_pad_start_task:<mpph264enc0:src> created task 0x7fb40303b0
0:00:01.099231165 143596   0x7fb4031300 INFO               GST_EVENT gstevent.c:927:gst_event_new_segment: creating segment event time segment start=0:00:00.000000000, offset=0:00:00.000000000, stop=99:99:99.999999999, rate=1.000000, applied_rate=1.000000, flags=0x00, time=0:00:00.000000000, base=0:00:00.000000000, position 0:00:00.000000000, duration 99:99:99.999999999
0:00:01.099700666 143596   0x7fb4031300 INFO               GST_EVENT gstevent.c:847:gst_event_new_caps: creating caps event application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, ssrc=(uint)2703053493, timestamp-offset=(uint)840473198, seqnum-offset=(uint)3833, a-framerate=(string)10
/GstPipeline:pipeline0/GstRtpH264Pay:pay0.GstPad:src: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, ssrc=(uint)2703053493, timestamp-offset=(uint)840473198, seqnum-offset=(uint)3833, a-framerate=(string)10
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, ssrc=(uint)2703053493, timestamp-offset=(uint)840473198, seqnum-offset=(uint)3833, a-framerate=(string)10
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0.GstPad:sink: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, ssrc=(uint)2703053493, timestamp-offset=(uint)840473198, seqnum-offset=(uint)3833, a-framerate=(string)10
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, ssrc=(uint)2703053493, timestamp-offset=(uint)840473198, seqnum-offset=(uint)3833, a-framerate=(string)10
0:00:01.101037085 143596   0x7fb4031300 INFO               GST_EVENT gstevent.c:847:gst_event_new_caps: creating caps event application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"Z2QQM6wbGqA8AEPoQAAAAwBAAAAFI8IhGoA\=\,aO4xshs\=", payload=(int)96, seqnum-offset=(uint)3833, timestamp-offset=(uint)840473198, ssrc=(uint)2703053493, a-framerate=(string)10
/GstPipeline:pipeline0/GstRtpH264Pay:pay0.GstPad:src: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"Z2QQM6wbGqA8AEPoQAAAAwBAAAAFI8IhGoA\=\,aO4xshs\=", payload=(int)96, seqnum-offset=(uint)3833, timestamp-offset=(uint)840473198, ssrc=(uint)2703053493, a-framerate=(string)10
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"Z2QQM6wbGqA8AEPoQAAAAwBAAAAFI8IhGoA\=\,aO4xshs\=", payload=(int)96, seqnum-offset=(uint)3833, timestamp-offset=(uint)840473198, ssrc=(uint)2703053493, a-framerate=(string)10
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0.GstPad:sink: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"Z2QQM6wbGqA8AEPoQAAAAwBAAAAFI8IhGoA\=\,aO4xshs\=", payload=(int)96, seqnum-offset=(uint)3833, timestamp-offset=(uint)840473198, ssrc=(uint)2703053493, a-framerate=(string)10
0:00:01.101658044 143596   0x7fb4031300 INFO              GST_STATES gstbin.c:3446:bin_handle_async_done:<fpsdisplaysink0> committing state from READY to PAUSED, old pending PAUSED
0:00:01.101719003 143596   0x7fb4031300 INFO              GST_STATES gstbin.c:3469:bin_handle_async_done:<fpsdisplaysink0> completed state change, pending VOID
0:00:01.101792503 143596   0x7fb4031300 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<fpsdisplaysink0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"Z2QQM6wbGqA8AEPoQAAAAwBAAAAFI8IhGoA\=\,aO4xshs\=", payload=(int)96, seqnum-offset=(uint)3833, timestamp-offset=(uint)840473198, ssrc=(uint)2703053493, a-framerate=(string)10
0:00:01.101869503 143596   0x7fb4031300 INFO              GST_STATES gstbin.c:3455:bin_handle_async_done:<pipeline0> setting state from PAUSED to PAUSED, pending PLAYING
0:00:01.101921128 143596   0x7fb4031300 INFO              GST_STATES gstbin.c:3477:bin_handle_async_done:<pipeline0> continue state change, pending PLAYING
/GstPipeline:pipeline0/GstRtpH264Pay:pay0: timestamp = 840491579
0:00:01.102300879 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:3273:gst_bin_continue_func:<pipeline0> continue state change PAUSED to PLAYING, final PLAYING
/GstPipeline:pipeline0/GstRtpH264Pay:pay0: seqnum = 3833
0:00:01.102520796 143596   0x7fa0004de0 INFO               GST_EVENT gstevent.c:1480:gst_event_new_latency: creating latency event 0:00:00.120000000
0:00:01.102684129 143596   0x7fa0004de0 INFO                     bin gstbin.c:2808:gst_bin_do_latency_func:<pipeline0> configured latency of 0:00:00.120000000
0:00:01.102811005 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<fpsdisplaysink0> current PAUSED pending VOID_PENDING, desired next PLAYING
0:00:01.103102088 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<fakesink0> current PAUSED pending VOID_PENDING, desired next PLAYING
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = true
0:00:01.103190463 143596   0x7fa0004de0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<fakesink0> completed state change to PLAYING
0:00:01.103242089 143596   0x7fa0004de0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<fakesink0> notifying about state-changed PAUSED to PLAYING (VOID_PENDING pending)
0:00:01.103381797 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<fpsdisplaysink0> child 'fakesink0' changed state to 4(PLAYING) successfully
0:00:01.103437506 143596   0x7fa0004de0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<fpsdisplaysink0> completed state change to PLAYING
0:00:01.103482422 143596   0x7fa0004de0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<fpsdisplaysink0> notifying about state-changed PAUSED to PLAYING (VOID_PENDING pending)
0:00:01.103629131 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'fpsdisplaysink0' changed state to 4(PLAYING) successfully
0:00:01.103694756 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<pay0> current PLAYING pending VOID_PENDING, desired next PLAYING
0:00:01.103741423 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2646:gst_bin_element_set_state:<pay0> skipping transition from PLAYING to  PLAYING
0:00:01.103771464 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'pay0' changed state to 4(PLAYING) successfully
0:00:01.103828923 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<mpph264enc0> current PLAYING pending VOID_PENDING, desired next PLAYING
0:00:01.103875298 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2646:gst_bin_element_set_state:<mpph264enc0> skipping transition from PLAYING to  PLAYING
0:00:01.103922256 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'mpph264enc0' changed state to 4(PLAYING) successfully
0:00:01.103976798 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<mppjpegdec0> current PLAYING pending VOID_PENDING, desired next PLAYING
0:00:01.104024340 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2646:gst_bin_element_set_state:<mppjpegdec0> skipping transition from PLAYING to  PLAYING
0:00:01.104071590 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'mppjpegdec0' changed state to 4(PLAYING) successfully
0:00:01.104124965 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<capsfilter0> current PLAYING pending VOID_PENDING, desired next PLAYING
0:00:01.104169590 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2646:gst_bin_element_set_state:<capsfilter0> skipping transition from PLAYING to  PLAYING
0:00:01.104214798 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'capsfilter0' changed state to 4(PLAYING) successfully
0:00:01.104265840 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<v4l2src0> current PLAYING pending VOID_PENDING, desired next PLAYING
0:00:01.104310465 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2646:gst_bin_element_set_state:<v4l2src0> skipping transition from PLAYING to  PLAYING
0:00:01.104356549 143596   0x7fa0004de0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'v4l2src0' changed state to 4(PLAYING) successfully
0:00:01.104406715 143596   0x7fa0004de0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<pipeline0> completed state change to PLAYING
0:00:01.104455715 143596   0x7fa0004de0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<pipeline0> notifying about state-changed PAUSED to PLAYING (VOID_PENDING pending)
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 8, dropped: 0, current: 14.52, average: 14.52
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 12, dropped: 0, current: 7.45, average: 11.03
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 18, dropped: 0, current: 11.45, average: 11.17
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 22, dropped: 0, current: 7.27, average: 10.18
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 28, dropped: 0, current: 9.98, average: 10.13
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 32, dropped: 0, current: 7.58, average: 9.73
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 38, dropped: 0, current: 11.50, average: 9.97
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 42, dropped: 0, current: 7.21, average: 9.62
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 48, dropped: 0, current: 8.90, average: 9.52
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 54, dropped: 0, current: 10.25, average: 9.60
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 58, dropped: 0, current: 7.04, average: 9.36
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 64, dropped: 0, current: 11.70, average: 9.54
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 68, dropped: 0, current: 7.11, average: 9.35
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 74, dropped: 0, current: 11.03, average: 9.47
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 78, dropped: 0, current: 7.24, average: 9.32
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 84, dropped: 0, current: 8.10, average: 9.22
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 90, dropped: 0, current: 11.17, average: 9.33
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 95, dropped: 0, current: 7.49, average: 9.21
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 101, dropped: 0, current: 10.09, average: 9.26
 RgaBlit(1465) RGA_BLIT fail: Invalid argument
 RgaBlit(1466) RGA_BLIT fail: Invalid argument
fd-vir-phy-hnd-format[188, (nil), (nil), 0, 0]
rect[0, 0, 3840, 2160, 3840, 2160, 512, 0]
f-blend-size-rotation-col-log-mmu[0, 0, 0, 0, 0, 0, 1]
fd-vir-phy-hnd-format[189, (nil), (nil), 0, 0]
rect[0, 0, 3840, 2160, 11520, 2160, 2560, 0]
f-blend-size-rotation-col-log-mmu[0, 0, 0, 0, 0, 0, 1]
This output the user patamaters when rga call blit fail
0:00:12.216973436 143596   0x5570539860 WARN                     mpp gstmpp.c:251:gst_mpp_rga_do_convert: failed to blit

(gst-launch-1.0:143596): GStreamer-WARNING **: 10:57:02.069: free_priv_data: object finalizing but still has 1 parents (object:0x7fb402e690)

(gst-launch-1.0:143596): GStreamer-CRITICAL **: 10:57:02.069: gst_mini_object_unlock: assertion 'state >= SHARE_ONE' failed
^Chandling interrupt.
Interrupt: Stopping pipeline ...
EOS on shutdown enabled -- Forcing EOS on the pipeline
^C
(base) root@firefly:~#

Radxa-Zero where do I get gallium swrast?

I need vulkan support for my purposes on the Radxa-zero, but building your repository with vulkan set to auto replies with the following message:
meson.build:298:2: ERROR: Problem encountered: swrast vulkan requires gallium swrast
Now, I've tried compiling and building mesa-23.3.3 with gallium swrast support and installing that, but this hasn't fixed the issue. I'm still getting the issue.

What do I need to do to provide gallium swrast for your repository?

help building

hi,
trying to build for rk3588, it is missing the kernel. where should i look for ?
also, ive used firefly sdk before, and there are many components such as rockit which are missing here. can you help me to understand
where to get the full sdk from rockchip?

Which rockchip repo should we focus on?

Hi, I noticed that the mpp and gstreamer-rockchip branches do not match the commits of the relevant repo in the rockchip-linux organization.

Does this mean that all future official work is done in this repo? Thank You!

mpph264enc hangs and doesn't output anything

Hello,
I cannot get any output from mpph264enc. I tried all kind of combinations but no luck.

(base) root@firefly:~# gst-launch-1.0 --gst-debug=4 videotestsrc ! 'video/x-raw,format=YUY2,width=1920,height=1080,framrate=30/1' ! mpph264enc ! 'video/x-h264' ! h264parse ! 'video/x-h264' ! fpsdisplaysink video-sink=fakesink text-overlay=false sync=false -ve
0:00:00.001258252 982791   0x558a0b42c0 INFO                GST_INIT gstmessage.c:129:_priv_gst_message_initialize: init messages
0:00:00.002497713 982791   0x558a0b42c0 INFO                GST_INIT gstcontext.c:85:_priv_gst_context_initialize: init contexts
0:00:00.003057131 982791   0x558a0b42c0 INFO      GST_PLUGIN_LOADING gstplugin.c:325:_priv_gst_plugin_initialize: registering 0 static plugins
0:00:00.003313798 982791   0x558a0b42c0 INFO      GST_PLUGIN_LOADING gstplugin.c:233:gst_plugin_register_static: registered static plugin "staticelements"
0:00:00.003354339 982791   0x558a0b42c0 INFO      GST_PLUGIN_LOADING gstplugin.c:235:gst_plugin_register_static: added static plugin "staticelements", result: 1
0:00:00.003389339 982791   0x558a0b42c0 INFO            GST_REGISTRY gstregistry.c:1755:ensure_current_registry: reading registry cache: /root/.cache/gstreamer-1.0/registry.aarch64.bin
0:00:00.042374369 982791   0x558a0b42c0 INFO            GST_REGISTRY gstregistrybinary.c:666:priv_gst_registry_binary_read_cache: loaded /root/.cache/gstreamer-1.0/registry.aarch64.bin in 0.038918 seconds
0:00:00.042504453 982791   0x558a0b42c0 INFO            GST_REGISTRY gstregistry.c:1614:scan_and_update_registry: Validating plugins from registry cache: /root/.cache/gstreamer-1.0/registry.aarch64.bin
0:00:00.044417498 982791   0x558a0b42c0 INFO            GST_REGISTRY gstregistry.c:1713:scan_and_update_registry: Registry cache has not changed
0:00:00.044437623 982791   0x558a0b42c0 INFO            GST_REGISTRY gstregistry.c:1790:ensure_current_registry: registry reading and updating done, result = 1
0:00:00.044448707 982791   0x558a0b42c0 INFO                GST_INIT gst.c:806:init_post: GLib runtime version: 2.66.8
0:00:00.044453957 982791   0x558a0b42c0 INFO                GST_INIT gst.c:808:init_post: GLib headers version: 2.66.8
0:00:00.044457457 982791   0x558a0b42c0 INFO                GST_INIT gst.c:810:init_post: initialized GStreamer successfully
0:00:00.044525998 982791   0x558a0b42c0 INFO            GST_PIPELINE gstparse.c:344:gst_parse_launch_full: parsing pipeline description 'videotestsrc ! video/x-raw,format=YUY2,width=1920,height=1080,framrate=30/1 ! mpph264enc ! video/x-h264 ! h264parse ! video/x-h264 ! fpsdisplaysink video-sink=fakesink text-overlay=false sync=false '
0:00:00.048696256 982791   0x558a0b42c0 INFO      GST_PLUGIN_LOADING gstplugin.c:915:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstvideotestsrc.so" loaded
0:00:00.048722214 982791   0x558a0b42c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "videotestsrc"
0:00:00.048952632 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseSrc@0x558a3314e0> adding pad 'src'
0:00:00.051724928 982791   0x558a0b42c0 INFO      GST_PLUGIN_LOADING gstplugin.c:915:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstrockchipmpp.so" loaded
0:00:00.051743595 982791   0x558a0b42c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "mpph264enc"
0:00:00.051926762 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstVideoEncoder@0x558a33d0c0> adding pad 'sink'
0:00:00.051942512 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstVideoEncoder@0x558a33d0c0> adding pad 'src'
0:00:00.053366431 982791   0x558a0b42c0 INFO      GST_PLUGIN_LOADING gstplugin.c:915:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstvideoparsersbad.so" loaded
0:00:00.053380723 982791   0x558a0b42c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "h264parse"
0:00:00.053466182 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseParse@0x558a341280> adding pad 'sink'
0:00:00.053482223 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseParse@0x558a341280> adding pad 'src'
0:00:00.053507890 982791   0x558a0b42c0 INFO               baseparse gstbaseparse.c:4041:gst_base_parse_set_pts_interpolation:<GstH264Parse@0x558a341280> PTS interpolation: no
0:00:00.053515473 982791   0x558a0b42c0 INFO               baseparse gstbaseparse.c:4059:gst_base_parse_set_infer_ts:<GstH264Parse@0x558a341280> TS inferring: no
0:00:00.055993186 982791   0x558a0b42c0 INFO      GST_PLUGIN_LOADING gstplugin.c:915:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstdebugutilsbad.so" loaded
0:00:00.056008061 982791   0x558a0b42c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "fpsdisplaysink"
0:00:00.056134936 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstFPSDisplaySink@0x558a34c150> adding pad 'sink'
0:00:00.056163520 982791   0x558a0b42c0 INFO            GST_PIPELINE gstparse.c:344:gst_parse_launch_full: parsing pipeline description 'fakesink'
0:00:00.056738104 982791   0x558a0b42c0 INFO      GST_PLUGIN_LOADING gstplugin.c:915:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstcoreelements.so" loaded
0:00:00.056753854 982791   0x558a0b42c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "fakesink"
0:00:00.056879563 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseSink@0x558a3582d0> adding pad 'sink'
0:00:00.056956563 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:1009:gst_element_get_static_pad: found pad fakesink0:sink
0:00:00.056985730 982791   0x558a0b42c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "pipeline"
0:00:00.057078771 982791   0x558a0b42c0 INFO            GST_PIPELINE gst/parse/grammar.y:689:gst_parse_perform_link: linking some pad of GstVideoTestSrc named videotestsrc0 to some pad of GstMppH264Enc named mpph264enc0 (0/0) with caps "video/x-raw, format=(string)YUY2, width=(int)1920, height=(int)1080, framrate=(fraction)30/1"
0:00:00.057089563 982791   0x558a0b42c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "capsfilter"
0:00:00.057157522 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseTransform@0x558a35c170> adding pad 'sink'
0:00:00.057170355 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseTransform@0x558a35c170> adding pad 'src'
0:00:00.057181438 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2115:gst_bin_get_state_func:<pipeline0> getting state
0:00:00.057200397 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<capsfilter0> completed state change to NULL
0:00:00.057217605 982791   0x558a0b42c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.057230730 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstutils.c:1816:gst_element_link_pads_full: trying to link element videotestsrc0:(any) to element capsfilter0:sink
0:00:00.057238022 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:1009:gst_element_get_static_pad: found pad capsfilter0:sink
0:00:00.057244147 982791   0x558a0b42c0 INFO                GST_PADS gstutils.c:1632:prepare_link_maybe_ghosting: videotestsrc0 and capsfilter0 in same bin, no need for ghost pads
0:00:00.057263397 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2404:gst_pad_link_prepare: trying to link videotestsrc0:src and capsfilter0:sink
0:00:00.057285272 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<capsfilter0:src> pad has no peer
0:00:00.057318814 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2612:gst_pad_link_full: linked videotestsrc0:src and capsfilter0:sink, successful
0:00:00.057325230 982791   0x558a0b42c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.057330480 982791   0x558a0b42c0 INFO               GST_EVENT gstpad.c:5925:gst_pad_send_event_unchecked:<videotestsrc0:src> Received event on flushing pad. Discarding
0:00:00.057343897 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstutils.c:1816:gst_element_link_pads_full: trying to link element capsfilter0:src to element mpph264enc0:(any)
0:00:00.057369855 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:1009:gst_element_get_static_pad: found pad capsfilter0:src
0:00:00.057380939 982791   0x558a0b42c0 INFO                GST_PADS gstutils.c:1079:gst_pad_check_link: trying to link capsfilter0:src and mpph264enc0:sink
0:00:00.057419439 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<mpph264enc0:src> pad has no peer
0:00:00.057453564 982791   0x558a0b42c0 INFO                GST_PADS gstutils.c:1632:prepare_link_maybe_ghosting: capsfilter0 and mpph264enc0 in same bin, no need for ghost pads
0:00:00.057463481 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2404:gst_pad_link_prepare: trying to link capsfilter0:src and mpph264enc0:sink
0:00:00.057476897 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<mpph264enc0:src> pad has no peer
0:00:00.057494689 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2612:gst_pad_link_full: linked capsfilter0:src and mpph264enc0:sink, successful
0:00:00.057500814 982791   0x558a0b42c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.057504314 982791   0x558a0b42c0 INFO               GST_EVENT gstpad.c:5925:gst_pad_send_event_unchecked:<capsfilter0:src> Received event on flushing pad. Discarding
0:00:00.057520939 982791   0x558a0b42c0 INFO            GST_PIPELINE gst/parse/grammar.y:689:gst_parse_perform_link: linking some pad of GstMppH264Enc named mpph264enc0 to some pad of GstH264Parse named h264parse0 (0/0) with caps "video/x-h264"
0:00:00.057528814 982791   0x558a0b42c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "capsfilter"
0:00:00.057541647 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseTransform@0x558a35c4b0> adding pad 'sink'
0:00:00.057552731 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseTransform@0x558a35c4b0> adding pad 'src'
0:00:00.057562356 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2115:gst_bin_get_state_func:<pipeline0> getting state
0:00:00.057576356 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<capsfilter1> completed state change to NULL
0:00:00.057585981 982791   0x558a0b42c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.057593272 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstutils.c:1816:gst_element_link_pads_full: trying to link element mpph264enc0:(any) to element capsfilter1:sink
0:00:00.057597939 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:1009:gst_element_get_static_pad: found pad capsfilter1:sink
0:00:00.057602314 982791   0x558a0b42c0 INFO                GST_PADS gstutils.c:1632:prepare_link_maybe_ghosting: mpph264enc0 and capsfilter1 in same bin, no need for ghost pads
0:00:00.057611939 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2404:gst_pad_link_prepare: trying to link mpph264enc0:src and capsfilter1:sink
0:00:00.057620981 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<capsfilter1:src> pad has no peer
0:00:00.057631189 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2612:gst_pad_link_full: linked mpph264enc0:src and capsfilter1:sink, successful
0:00:00.057637023 982791   0x558a0b42c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.057640231 982791   0x558a0b42c0 INFO               GST_EVENT gstpad.c:5925:gst_pad_send_event_unchecked:<mpph264enc0:src> Received event on flushing pad. Discarding
0:00:00.057647523 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstutils.c:1816:gst_element_link_pads_full: trying to link element capsfilter1:src to element h264parse0:(any)
0:00:00.057651898 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:1009:gst_element_get_static_pad: found pad capsfilter1:src
0:00:00.057656856 982791   0x558a0b42c0 INFO                GST_PADS gstutils.c:1079:gst_pad_check_link: trying to link capsfilter1:src and h264parse0:sink
0:00:00.057671731 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<h264parse0:src> pad has no peer
0:00:00.057684273 982791   0x558a0b42c0 INFO                GST_PADS gstutils.c:1632:prepare_link_maybe_ghosting: capsfilter1 and h264parse0 in same bin, no need for ghost pads
0:00:00.057693606 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2404:gst_pad_link_prepare: trying to link capsfilter1:src and h264parse0:sink
0:00:00.057702356 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<h264parse0:src> pad has no peer
0:00:00.057712856 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2612:gst_pad_link_full: linked capsfilter1:src and h264parse0:sink, successful
0:00:00.057716356 982791   0x558a0b42c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.057719564 982791   0x558a0b42c0 INFO               GST_EVENT gstpad.c:5925:gst_pad_send_event_unchecked:<capsfilter1:src> Received event on flushing pad. Discarding
0:00:00.057733564 982791   0x558a0b42c0 INFO            GST_PIPELINE gst/parse/grammar.y:689:gst_parse_perform_link: linking some pad of GstH264Parse named h264parse0 to some pad of GstFPSDisplaySink named fpsdisplaysink0 (0/0) with caps "video/x-h264"
0:00:00.057741148 982791   0x558a0b42c0 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "capsfilter"
0:00:00.057749314 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseTransform@0x558a35c7f0> adding pad 'sink'
0:00:00.057759814 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:752:gst_element_add_pad:<GstBaseTransform@0x558a35c7f0> adding pad 'src'
0:00:00.057768564 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2115:gst_bin_get_state_func:<pipeline0> getting state
0:00:00.057783148 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<capsfilter2> completed state change to NULL
0:00:00.057791023 982791   0x558a0b42c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.057814648 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstutils.c:1816:gst_element_link_pads_full: trying to link element h264parse0:(any) to element capsfilter2:sink
0:00:00.057819315 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:1009:gst_element_get_static_pad: found pad capsfilter2:sink
0:00:00.057830398 982791   0x558a0b42c0 INFO                GST_PADS gstutils.c:1632:prepare_link_maybe_ghosting: h264parse0 and capsfilter2 in same bin, no need for ghost pads
0:00:00.057837981 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2404:gst_pad_link_prepare: trying to link h264parse0:src and capsfilter2:sink
0:00:00.057849065 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<capsfilter2:src> pad has no peer
0:00:00.057857231 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2612:gst_pad_link_full: linked h264parse0:src and capsfilter2:sink, successful
0:00:00.057863065 982791   0x558a0b42c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.057866273 982791   0x558a0b42c0 INFO               GST_EVENT gstpad.c:5925:gst_pad_send_event_unchecked:<h264parse0:src> Received event on flushing pad. Discarding
0:00:00.057873273 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstutils.c:1816:gst_element_link_pads_full: trying to link element capsfilter2:src to element fpsdisplaysink0:(any)
0:00:00.057879981 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:1009:gst_element_get_static_pad: found pad capsfilter2:src
0:00:00.057886106 982791   0x558a0b42c0 INFO                GST_PADS gstutils.c:1079:gst_pad_check_link: trying to link capsfilter2:src and fpsdisplaysink0:sink
0:00:00.057903315 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<sink:proxypad0> pad has no peer
0:00:00.057909731 982791   0x558a0b42c0 INFO                GST_PADS gstutils.c:1632:prepare_link_maybe_ghosting: capsfilter2 and fpsdisplaysink0 in same bin, no need for ghost pads
0:00:00.057921398 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2404:gst_pad_link_prepare: trying to link capsfilter2:src and fpsdisplaysink0:sink
0:00:00.057933065 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:4336:gst_pad_peer_query:<sink:proxypad0> pad has no peer
0:00:00.057942398 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2612:gst_pad_link_full: linked capsfilter2:src and fpsdisplaysink0:sink, successful
0:00:00.057945898 982791   0x558a0b42c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.057949106 982791   0x558a0b42c0 INFO               GST_EVENT gstpad.c:5925:gst_pad_send_event_unchecked:<capsfilter2:src> Received event on flushing pad. Discarding
Setting pipeline to PAUSED ...
0:00:00.058051482 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<fpsdisplaysink0> current NULL pending VOID_PENDING, desired next READY
0:00:00.058061982 982791   0x558a0b42c0 INFO        GST_ELEMENT_PADS gstelement.c:1009:gst_element_get_static_pad: found pad fakesink0:sink
0:00:00.058069273 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2404:gst_pad_link_prepare: trying to link sink:proxypad0 and fakesink0:sink
0:00:00.058077148 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:2612:gst_pad_link_full: linked sink:proxypad0 and fakesink0:sink, successful
0:00:00.058080357 982791   0x558a0b42c0 INFO               GST_EVENT gstevent.c:1610:gst_event_new_reconfigure: creating reconfigure event
0:00:00.058094648 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<fakesink0> current NULL pending VOID_PENDING, desired next READY
0:00:00.058104857 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<fakesink0> completed state change to READY
0:00:00.058110690 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<fakesink0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.058134023 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<fpsdisplaysink0> child 'fakesink0' changed state to 2(READY) successfully
0:00:00.058145398 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<fpsdisplaysink0> completed state change to READY
0:00:00.058150357 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<fpsdisplaysink0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.058156773 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'fpsdisplaysink0' changed state to 2(READY) successfully
0:00:00.058163482 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<capsfilter2> current NULL pending VOID_PENDING, desired next READY
0:00:00.058171648 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<capsfilter2> completed state change to READY
0:00:00.058176315 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<capsfilter2> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.058183899 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'capsfilter2' changed state to 2(READY) successfully
0:00:00.058191774 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<h264parse0> current NULL pending VOID_PENDING, desired next READY
0:00:00.058198482 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<h264parse0> completed state change to READY
0:00:00.058203149 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<h264parse0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.058212774 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'h264parse0' changed state to 2(READY) successfully
0:00:00.058220649 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<capsfilter1> current NULL pending VOID_PENDING, desired next READY
0:00:00.058225315 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<capsfilter1> completed state change to READY
0:00:00.058229690 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<capsfilter1> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.058247190 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'capsfilter1' changed state to 2(READY) successfully
0:00:00.058256232 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<mpph264enc0> current NULL pending VOID_PENDING, desired next READY
0:00:00.058263815 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<mpph264enc0> completed state change to READY
0:00:00.058268190 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<mpph264enc0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.058274315 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'mpph264enc0' changed state to 2(READY) successfully
0:00:00.058283065 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<capsfilter0> current NULL pending VOID_PENDING, desired next READY
0:00:00.058290649 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<capsfilter0> completed state change to READY
0:00:00.058297357 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<capsfilter0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.058304649 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'capsfilter0' changed state to 2(READY) successfully
0:00:00.058313107 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<videotestsrc0> current NULL pending VOID_PENDING, desired next READY
0:00:00.058320399 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<videotestsrc0> completed state change to READY
0:00:00.058325065 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<videotestsrc0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.058331774 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'videotestsrc0' changed state to 2(READY) successfully
0:00:00.058352482 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2741:gst_element_continue_state:<pipeline0> committing state from NULL to READY, pending PAUSED, next PAUSED
0:00:00.058358315 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<pipeline0> notifying about state-changed NULL to READY (PAUSED pending)
0:00:00.058395357 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2749:gst_element_continue_state:<pipeline0> continue state change READY to PAUSED, final PAUSED
0:00:00.058409649 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<fpsdisplaysink0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.058440274 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<fakesink0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.058460982 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2984:gst_bin_change_state_func:<fpsdisplaysink0> child 'fakesink0' is changing state asynchronously to PAUSED
0:00:00.058477607 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2984:gst_bin_change_state_func:<pipeline0> child 'fpsdisplaysink0' is changing state asynchronously to PAUSED
0:00:00.058486357 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<capsfilter2> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.058495399 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<capsfilter2> completed state change to PAUSED
0:00:00.058502399 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<capsfilter2> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:00.058508816 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'capsfilter2' changed state to 3(PAUSED) successfully
0:00:00.058516982 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<h264parse0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.058749441 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<h264parse0> completed state change to PAUSED
0:00:00.058759650 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<h264parse0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:00.058771608 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'h264parse0' changed state to 3(PAUSED) successfully
0:00:00.058778900 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<capsfilter1> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.058790275 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<capsfilter1> completed state change to PAUSED
0:00:00.058798441 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<capsfilter1> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:00.058806900 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'capsfilter1' changed state to 3(PAUSED) successfully
0:00:00.058813025 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<mpph264enc0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.059328109 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<mpph264enc0> completed state change to PAUSED
0:00:00.059342401 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<mpph264enc0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:00.059357859 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'mpph264enc0' changed state to 3(PAUSED) successfully
0:00:00.059368067 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<capsfilter0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.059379151 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<capsfilter0> completed state change to PAUSED
0:00:00.059387026 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<capsfilter0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:00.059393442 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'capsfilter0' changed state to 3(PAUSED) successfully
0:00:00.059401901 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2528:gst_bin_element_set_state:<videotestsrc0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.059433984 982791   0x558a0b42c0 INFO                 basesrc gstbasesrc.c:1430:gst_base_src_do_seek:<videotestsrc0> seeking: time segment start=0:00:00.000000000, offset=0:00:00.000000000, stop=99:99:99.999999999, rate=1.000000, applied_rate=1.000000, flags=0x00, time=0:00:00.000000000, base=0:00:00.000000000, position 0:00:00.000000000, duration 99:99:99.999999999
0:00:00.059466651 982791   0x558a0b42c0 INFO                    task gsttask.c:516:gst_task_set_lock: setting stream lock 0x558a332180 on task 0x558a343290
0:00:00.059474818 982791   0x558a0b42c0 INFO                GST_PADS gstpad.c:6270:gst_pad_start_task:<videotestsrc0:src> created task 0x558a343290
0:00:00.059543068 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2769:gst_element_continue_state:<videotestsrc0> completed state change to PAUSED
0:00:00.059552109 982791   0x558a0b42c0 INFO              GST_STATES gstelement.c:2669:_priv_gst_element_state_changed:<videotestsrc0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:00.059578651 982791   0x558a0b42c0 INFO              GST_STATES gstbin.c:2977:gst_bin_change_state_func:<pipeline0> child 'videotestsrc0' changed state to 3(PAUSED) successfully
0:00:00.059590609 982791   0x558a0b42c0 INFO                pipeline gstpipeline.c:529:gst_pipeline_change_state:<pipeline0> pipeline is not live
Pipeline is PREROLLING ...
0:00:00.059680735 982791   0x558a35e980 INFO        GST_ELEMENT_PADS gstelement.c:1006:gst_element_get_static_pad: no such pad 'sink' in element "videotestsrc0"
0:00:00.059741110 982791   0x558a35e980 FIXME                default gstutils.c:4025:gst_pad_create_stream_id_internal:<videotestsrc0:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = false
0:00:00.060362944 982791   0x558a35e980 INFO               GST_EVENT gstevent.c:847:gst_event_new_caps: creating caps event video/x-raw, format=(string)YUY2, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, multiview-mode=(string)mono, framrate=(fraction)30/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstVideoTestSrc:videotestsrc0.GstPad:src: caps = video/x-raw, format=(string)YUY2, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, multiview-mode=(string)mono, framrate=(fraction)30/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive
0:00:00.060678820 982791   0x558a35e980 INFO           basetransform gstbasetransform.c:1325:gst_base_transform_setcaps:<capsfilter0> reuse caps
0:00:00.060785278 982791   0x558a35e980 INFO               GST_EVENT gstevent.c:847:gst_event_new_caps: creating caps event video/x-raw, format=(string)YUY2, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, multiview-mode=(string)mono, framrate=(fraction)30/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw, format=(string)YUY2, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, multiview-mode=(string)mono, framrate=(fraction)30/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive
0:00:00.061060612 982791   0x558a35e980 INFO                  mppenc gstmppenc.c:670:gst_mpp_enc_set_format:<mpph264enc0> applying YUY2 1920x1080 (3840x1080)
0:00:00.061753613 982791   0x558a35e980 INFO               GST_EVENT gstevent.c:847:gst_event_new_caps: creating caps event video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
0:00:00.061858322 982791   0x558a35e980 INFO           basetransform gstbasetransform.c:1325:gst_base_transform_setcaps:<capsfilter1> reuse caps
/GstPipeline:pipeline0/GstMppH264Enc:mpph264enc0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
0:00:00.061924530 982791   0x558a35e980 INFO               GST_EVENT gstevent.c:847:gst_event_new_caps: creating caps event video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
0:00:00.062161656 982791   0x558a35e980 INFO               GST_EVENT gstevent.c:847:gst_event_new_caps: creating caps event video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, parsed=(boolean)true
/GstPipeline:pipeline0/GstCapsFilter:capsfilter1.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
0:00:00.062287656 982791   0x558a35e980 INFO           basetransform gstbasetransform.c:1325:gst_base_transform_setcaps:<capsfilter2> reuse caps
/GstPipeline:pipeline0/GstH264Parse:h264parse0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, parsed=(boolean)true
0:00:00.062353865 982791   0x558a35e980 INFO               GST_EVENT gstevent.c:847:gst_event_new_caps: creating caps event video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, parsed=(boolean)true
/GstPipeline:pipeline0/GstCapsFilter:capsfilter2.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, parsed=(boolean)true
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, parsed=(boolean)true
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, parsed=(boolean)true
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, parsed=(boolean)true
/GstPipeline:pipeline0/GstCapsFilter:capsfilter2.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, parsed=(boolean)true
/GstPipeline:pipeline0/GstH264Parse:h264parse0.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
/GstPipeline:pipeline0/GstCapsFilter:capsfilter1.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)High, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono
/GstPipeline:pipeline0/GstMppH264Enc:mpph264enc0.GstPad:sink: caps = video/x-raw, format=(string)YUY2, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, multiview-mode=(string)mono, framrate=(fraction)30/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw, format=(string)YUY2, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, multiview-mode=(string)mono, framrate=(fraction)30/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive
0:00:00.103361440 982791   0x558a35e980 INFO               GST_EVENT gstevent.c:927:gst_event_new_segment: creating segment event time segment start=0:00:00.000000000, offset=0:00:00.000000000, stop=99:99:99.999999999, rate=1.000000, applied_rate=1.000000, flags=0x00, time=0:00:00.000000000, base=0:00:00.000000000, position 0:00:00.000000000, duration 99:99:99.999999999
0:00:00.103409857 982791   0x558a35e980 INFO                 basesrc gstbasesrc.c:3018:gst_base_src_loop:<videotestsrc0> marking pending DISCONT
0:00:00.103463523 982791   0x558a35e980 INFO                    task gsttask.c:516:gst_task_set_lock: setting stream lock 0x558a332620 on task 0x7fa0020830
0:00:00.103478982 982791   0x558a35e980 INFO                GST_PADS gstpad.c:6270:gst_pad_start_task:<mpph264enc0:src> created task 0x7fa0020830


^Chandling interrupt.
Interrupt: Stopping pipeline ...
EOS on shutdown enabled -- Forcing EOS on the pipeline
^C
(base) root@firefly:~# env|grep GST
GST_V4L2_PREFERRED_FOURCC=NV12:YU12:NV16:YUY2
GST_VIDEO_CONVERT_PREFERRED_FORMAT=NV12:NV16:I420:YUY2
GST_MPP_NO_RGA=0
GST_GL_PLATFORM=egl
GST_V4L2_USE_LIBV4L2=1
GST_INSPECT_NO_COLORS=1
GST_DEBUG_NO_COLOR=1
GST_V4L2SRC_DEFAULT_DEVICE=/dev/video-camera0
GST_V4L2SRC_RK_DEVICES=_mainpath:_selfpath:_bypass:_scale
GST_GL_API=gles2
GST_V4L2SRC_MAX_RESOLUTION=3840x2160
GST_MPP_VIDEODEC_DEFAULT_ARM_AFBC=1
(base) root@firefly:~#

ls *.deb

Failed to initialize MPP context?

I compiled these repos: librga (from rockchip_mirrors), mpp (this repo), ffmpeg-rk on a NanoPI R5C locally.
Then I also did "sudo make install" for all projects.

Now, when I try running this ffmpeg I got:

[hevc_rkmpp @ 0x55a919c7e0] Failed to initialize MPP context (code = -1).
[hevc_rkmpp @ 0x55a919c7e0] Failed to initialize RKMPP decoder.

Can you help me understand which point is missing?

full path when linking with mali library

Hi @JeffyCN

It seems when building the shared objects.
It tends to put the full path to the mali driver instead of just the filename.

ldd /usr/local/lib/libgbm.so.1
	linux-vdso.so.1 (0xbed53000)
	libmali_hook.so.1 => /usr/local/lib/libmali_hook.so.1 (0xb6f00000)
	libc.so.6 => /lib/libc.so.6 (0xb6d80000)
	/mnt/sdcard/src/rockchip_mirrors/optimize_3/arm-linux-gnueabihf/libmali-midgard-t62x-r12p0-04rel0-wayland.so (0xb5d00000)
	libdrm.so.2 => /lib/libdrm.so.2 (0xb5cd0000)
	/lib/ld-linux-armhf.so.3 (0xb6f49000)
	librt.so.1 => /lib/librt.so.1 (0xb5cb0000)
	libpthread.so.0 => /lib/libpthread.so.0 (0xb5c90000)
	libdl.so.2 => /lib/libdl.so.2 (0xb5c70000)
	libwayland-client.so.0 => /lib/libwayland-client.so.0 (0xb5c50000)
	libwayland-server.so.0 => /lib/libwayland-server.so.0 (0xb5c30000)
	libstdc++.so.6 => /lib/libstdc++.so.6 (0xb5a50000)
	libm.so.6 => /lib/libm.so.6 (0xb59f0000)
	libgcc_s.so.1 => /lib/libgcc_s.so.1 (0xb59c0000)
	libffi.so.8 => /lib/libffi.so.8 (0xb59a0000)

Is there a way to fix this?

why many repos under rockchip-linux are gone

I want to download some files in repo https://github.com/rockchip-linux/rk-rootfs-build/, but I can't find the repo. I also find that other many repos are gone. Why did this happen? Can I find the missing repos somewhere else?

[RK3588] Number of platforms 0

cp mali_csffw.bin /lib/firmware/
meson  -Dplatform=gbm -Dkhr-header=true -Doptimize-level=O3 -Dgpu=valhall-g610 -Dversion=g6p0 ..
ninja install

rock-5b:build:# cat /etc/OpenCL/vendors/mesa.icd                                                                                                                 <libmali ✗>
/usr/local/lib/aarch64-linux-gnu/libmali.so

result

rock-5b:build:# clinfo                                                                                                                                           <libmali ✗>
Number of platforms                               0
rock-5b:build:#

OIncorrect address

rockchip_mirrors/package/pcre/pcre.mk

Line 8 in 965c07a

PCRE_SITE = https://ftp.pcre.org/pub/pcre

The url in the .mk refers to a non-existent address.

[RK3588] Single gstreamer pipeline not able to hit 4K@120 fps, but two separate pipelines hit 4K@60 fps each

I have a gstreamer pipeline either pulling for USB/MIPI/file I expect to be able to achieve 4K@120 FPS. However, I seem to be unable to get a single encoder to achieve 4K@120 fps. However, two pipelines at the same time are able to achieve >120 fps combined.

As videotestsrc isn't able to keep up on the RK3588, I run it at a slower framerate and duplicate frames with videorate for the purposes of a consistent input. I have tried with both live and test sources and the results seem to be the same.

EDIT: See below, but it looks like only a single rkvenc-core is being used in the 4K@120 fps case limiting it to 4K@60 fps. Is it possible to utilize the second core for 4K@120fps?

8k@30 fps, works as expected (~29 fps average):

gst-launch-1.0 videotestsrc ! video/x-raw,framerate=6/1 ! videorate ! queue ! video/x-raw,width=7680,height=4320,framerate=60/1,format=NV12 ! mpph265enc ! fpsdisplaysink video-sink=fakesink text-overlay=false -ve

1080P@240 fps, works as expected (~230 fps average):

gst-launch-1.0 videotestsrc ! video/x-raw,framerate=30/1 ! videorate ! queue ! video/x-raw,width=1920,height=1080,framerate=240/1,format=NV12 ! mpph265enc ! fpsdisplaysink video-sink=fakesink text-overlay=false -ve

4K@120 fps, Doesn't work as expected (63 fps average):

gst-launch-1.0 videotestsrc ! video/x-raw,framerate=30/1 ! videorate ! queue ! video/x-raw,width=3840,height=2160,framerate=120/1,format=NV12 ! mpph265enc ! fpsdisplaysink video-sink=fakesink text-overlay=false -ve

However, if I run 2x of the above 4K pipelines simultaneously, both achieve 4K@60 fps (120 fps total):

# In terminal 1:
gst-launch-1.0 videotestsrc ! video/x-raw,framerate=30/1 ! videorate ! queue ! video/x-raw,width=3840,height=2160,framerate=120/1,format=NV12 ! mpph265enc ! fpsdisplaysink video-sink=fakesink text-overlay=false -ve
# results in ~63 fps average

# In terminal 2:
gst-launch-1.0 videotestsrc ! video/x-raw,framerate=30/1 ! videorate ! queue ! video/x-raw,width=3840,height=2160,framerate=120/1,format=NV12 ! mpph265enc ! fpsdisplaysink video-sink=fakesink text-overlay=false -ve
# results in ~63 fps average

Same issue occurs using filesrc (60fps from 120fps source mkv):

gst-launch-1.0 filesrc location=/tmp/test.mkv ! matroskademux ! h265parse ! mppvideodec ! queue ! video/x-raw ! mpph265enc ! fpsdisplaysink video-sink=fakesink text-overlay=false -ve

Other system information:

Running rk3588-sd-ubuntu-jammy-desktop-5.10-arm64-20230115
Same performance using mpp from Rockchip Github and OS bundled
Using rockchip_mirrors' gstreamer-rockchip
GStreamer 1.20.3

dmesg output with debug on when running 2x4K@60fps (120 fps total):

[22140.018810] rk_vcodec: fdbd0000.rkvenc-core:0 session 18890:1027 time: 14574 us
[22140.018976] rk_vcodec: fdbe0000.rkvenc-core:1 session 18899:1031 time: 14595 us
[22140.033929] rk_vcodec: fdbd0000.rkvenc-core:0 session 18890:1027 time: 14627 us
[22140.034083] rk_vcodec: fdbe0000.rkvenc-core:1 session 18899:1031 time: 14565 us
[22140.049023] rk_vcodec: fdbd0000.rkvenc-core:0 session 18890:1027 time: 14640 us
[22140.051221] rk_vcodec: fdbe0000.rkvenc-core:1 session 18899:1031 time: 15537 us
[22140.064179] rk_vcodec: fdbd0000.rkvenc-core:0 session 18890:1027 time: 14634 us
[22140.066364] rk_vcodec: fdbe0000.rkvenc-core:1 session 18899:1031 time: 14640 us
[22140.081486] rk_vcodec: fdbe0000.rkvenc-core:1 session 18899:1031 time: 14572 us
[22140.082055] rk_vcodec: fdbd0000.rkvenc-core:0 session 18890:1027 time: 15549 us
[22140.097545] rk_vcodec: fdbd0000.rkvenc-core:0 session 18890:1027 time: 14587 us
[22140.097688] rk_vcodec: fdbe0000.rkvenc-core:1 session 18899:1031 time: 14569 us

dmesg output with debug on when running 1x4K@120fps (~63fps actual):

[22874.355580] rk_vcodec: fdbd0000.rkvenc-core:0 session 18951:1039 time: 14637 us
[22874.370727] rk_vcodec: fdbd0000.rkvenc-core:0 session 18951:1039 time: 14629 us
[22874.386210] rk_vcodec: fdbd0000.rkvenc-core:0 session 18951:1039 time: 14717 us
[22874.403979] rk_vcodec: fdbd0000.rkvenc-core:0 session 18951:1039 time: 15639 us

dmesg output with debug on when running 1x8k@30fps:

[22999.977358] rk_vcodec: fdbe0000.rkvenc-core:1 session 18970:1043 time: 29922 us
[23000.007269] rk_vcodec: fdbd0000.rkvenc-core:0 session 18970:1043 time: 29127 us
[23000.008150] rk_vcodec: fdbe0000.rkvenc-core:1 session 18970:1043 time: 29854 us
[23000.163325] rk_vcodec: fdbd0000.rkvenc-core:0 session 18970:1043 time: 29207 us
[23000.164595] rk_vcodec: fdbe0000.rkvenc-core:1 session 18970:1043 time: 30309 us

RgaBlit(1356) RGA_BLIT fail: Invalid argument RgaBlit(1357) RGA_BLIT fail: Invalid argument

I'm getting an error when using hardware acceleration for video scale conversion.

This video conversion consumes 80% of one core and there are complaints that this computer is too slow.
I run it on Rock 5b with 8GB mem.

Gstreamer is built from the latest radxa/meta-rockchip yocto configuration.

root@rockchip-rk3588-rock-5b:~# uname -a
Linux rockchip-rk3588-rock-5b 5.10.160-rockchip-standard #1 SMP Wed Aug 30 18:35:03 UTC 2023 aarch64 GNU/Linux

Is there any way to be able to use hardware acceleration for video conversion/scaling?

root@rockchip-rk3588-rock-5b:~#  GST_VIDEO_CONVERT_USE_RGA=1 gst-launch-1.0 v4l2src device=/dev/video0 ! video/x-raw, width=1920, height=1080, format=BGR, framerate=30/1, colorimetry=1:4:7:1, interlace-mode=progressive ! videoconvert ! videoscale ! video/x-raw,width=640,height=360,format=BGR ! videoconvert ! autovideosink
Setting pipeline to PAUSED ...
error: XDG_RUNTIME_DIR not set in the environment.
error: XDG_RUNTIME_DIR not set in the environment.
arm_release_ver of this libmali is 'g6p0-01eac0', rk_so_ver is '6'.
Failed creating base context during opening of kernel driver.
Kernel module may not have been loaded
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
rga_api version 1.3.2_[0] (RGA is compiling with meson base: $PRODUCT_BASE)
 RgaBlit(1356) RGA_BLIT fail: Invalid argument RgaBlit(1357) RGA_BLIT fail: Invalid argument
fd-vir-phy-hnd-format[0, 0x7f8c1c8000, (nil), (nil), 0]
rect[0, 0, 1920, 1080, 1920, 1080, 1792, 0]
f-blend-size-rotation-col-log-mmu[0, 0, 0, 0, 0, 0, 1]
fd-vir-phy-hnd-format[0, 0x7f78038090, (nil), (nil), 0]
rect[0, 0, 640, 360, 640, 360, 1792, 0]
f-blend-size-rotation-col-log-mmu[0, 0, 0, 0, 0, 0, 1]
This output the user patamaters when rga call blit fail
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstDfbVideoSink:autovideosink0-actual-sink-dfbvideo: A lot of buffers are being dropped.
Additional debug info:
../gstreamer-1.20.6/libs/gst/base/gstbasesink.c(3143): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstDfbVideoSink:autovideosink0-actual-sink-dfbvideo:
There may be a timestamping problem, or this computer is too slow.
 RgaBlit(1356) RGA_BLIT fail: Invalid argument RgaBlit(1357) RGA_BLIT fail: Invalid argument
fd-vir-phy-hnd-format[0, 0x7f8c1c8000, (nil), (nil), 0]
rect[0, 0, 1920, 1080, 1920, 1080, 1792, 0]
f-blend-size-rotation-col-log-mmu[0, 0, 0, 0, 0, 0, 1]
fd-vir-phy-hnd-format[0, 0x7f6c04c100, (nil), (nil), 0]
rect[0, 0, 640, 360, 640, 360, 1792, 0]
f-blend-size-rotation-col-log-mmu[0, 0, 0, 0, 0, 0, 1]
This output the user patamaters when rga call blit fail

kmsbufferpool: "The buffer will be not be reused. This is most likely a bug in this GstBufferPool subclass"

Hello! --

I've been playing with gstreamer on an Orange Pi 5 running Armbian Jammy (64bit), and I've been trying to test both arm64 and armhf. I've been using liujianfeng1994's PPA to setup playback (as documented here).

However, for my initial testing on armhf, I was failing to find a recent .deb of gstreamer1.0-rockchip1. I eventually found an old package (gstreamer1.0-rockchip1_1.10-5ayufan12_armhf.deb) from 2017 (!), and found that basic h264 playback was nice and smooth. I eventually wanted to have a more recent version of gstreamer1.0-rockchip1, so I cloned your rockchip_mirrors repo and successfully built the latest version using the attached armhf cross-file. Using the latest code, I ran into logs full of this:

0:00:05.837257189 77407 0xf6502d50 WARN            kmsallocator gstkmsallocator.c:526:gst_kms_allocator_dmabuf_import:<KMSMemory::allocator> Failed to close GEM handle: Invalid argument 22
0:00:05.852249697 77407 0xf6502d50 WARN              bufferpool gstbufferpool.c:1246:default_reset_buffer:<kmsbufferpool2> Buffer 0xf6525150 without the memory tag has maxsize (3110400) that is smaller than the configured buffer pool size (3133440). The buffer will be not be reused. This is most likely a bug in this GstBufferPool subclass
0:00:05.891802045 77407 0xf6502d50 WARN            videodecoder gstvideodecoder.c:3668:gst_video_decoder_clip_and_push_buf:<mppvideodec0> Dropping frame due to QoS. start:0:00:04.766666476 deadline:0:00:04.766666476 earliest_time:0:00:04.820110926

I did a little bit of digging in the gstreamer source to try to make sense of it, and it seems to do with the allocator making buffers that are for 1920x1080, but mppvideodec wanting 1920x1088 instead. I was trying to figure out a smart way to hack/fix it, but the allocator just doesn't have the vstride information, so I figure I'd ask an expert for help! Is the maxsize bug a known issue? Is there a good patch I should be using? I'd appreciate any information you have.

This is an easy repro:

curl -O https://test-videos.co.uk/vids/bigbuckbunny/mp4/h264/1080/Big_Buck_Bunny_1080_10s_5MB.mp4
ffmpeg -i Big_Buck_Bunny_1080_10s_5MB.mp4 -c:v copy -f h264 bunny.es

GST_DEBUG=2 gst-launch-1.0 filesrc location=bunny.es ! h264parse ! mppvideodec ! kmssink plane-id=68

(choose whatever plane-id you want)

armhf.txt

mppjpegdec format=RGB gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed

Hi,
mppjpegdec format=RGB errors and corrupts output frames when using 4K frames. Other formats works fine (RGBA for example).

Error example:

root@firefly:~/sensevision# gst-launch-1.0 -v v4l2src device=/dev/video12 ! image/jpeg,width=3840,height=2160,framerate=30/1 ! mppjpegdec format=RGB ! fakesink
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstMppJpegDec:mppjpegdec0.GstPad:src: caps = video/x-raw(memory:DMABuf), format=(string)RGB, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)2:1:5:1, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-raw(memory:DMABuf), format=(string)RGB, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)2:1:5:1, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstMppJpegDec:mppjpegdec0.GstPad:sink: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1

(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.052: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed
0:00:00.1 / 99:99:99.
(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.098: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed

(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.153: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed
0:00:00.4 / 99:99:99.
(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.194: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed

(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.254: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed
0:00:00.6 / 99:99:99.
(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.351: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed
0:00:00.6 / 99:99:99.
(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.375: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed

(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.434: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed
0:00:00.7 / 99:99:99.
(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.496: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed
0:00:00.8 / 99:99:99.
(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.593: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed

(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.619: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed
0:00:00.9 / 99:99:99.
(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.674: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed
0:00:01.0 / 99:99:99.
(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.775: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed

(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.796: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed

(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.854: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed
0:00:01.2 / 99:99:99.
(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:24.916: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed
0:00:01.2 / 99:99:99.
(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:25.019: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed

(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:25.039: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed
0:00:01.3 / 99:99:99.
(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:25.094: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed
^Chandling interrupt.
Interrupt: Stopping pipeline ...
Execution ended after 0:00:01.612582624
Setting pipeline to NULL ...

(gst-launch-1.0:396673): GStreamer-CRITICAL **: 19:18:25.194: gst_buffer_resize_range: assertion 'bufmax >= bufoffs + offset + size' failed
Freeing pipeline ...
root@firefly:~/sensevision#

Working example:

root@firefly:~/sensevision# gst-launch-1.0 -v v4l2src device=/dev/video12 ! image/jpeg,width=3840,height=2160,framerate=30/1 ! mppjpegdec format=RGBA ! fakesink
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstMppJpegDec:mppjpegdec0.GstPad:src: caps = video/x-raw(memory:DMABuf), format=(string)RGBA, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)2:1:5:1, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-raw(memory:DMABuf), format=(string)RGBA, width=(int)3840, height=(int)2160, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)2:1:5:1, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstMppJpegDec:mppjpegdec0.GstPad:sink: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = image/jpeg, width=(int)3840, height=(int)2160, framerate=(fraction)30/1, parsed=(boolean)true, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:4:5:1
^Chandling interrupt.
Interrupt: Stopping pipeline ...
Execution ended after 0:00:02.544840143
Setting pipeline to NULL ...
Freeing pipeline ...
root@firefly:~/sensevision#

jeffycn / rockchip_mirrors Goto Github PK

rockchip_mirrors's People

Contributors

Stargazers

Watchers

Forkers

rockchip_mirrors's Issues

result

Recommend Projects

Recommend Topics

Recommend Org