[Bug]: FFmpeg QSV VP9 oneVPL Encodes Produce Faulty Video That Can't Be Played Back Without Breaking/Corrupting Video Stream about media-driver HOT 16 CLOSED

Not sure if this is the same issue I'm having but I fixed this by encoding only with FFmpeg then remuxing the files with mkvmerge. There's something wrong with the muxing process in FFmpeg.

from media-driver.

Auto Created VSMGWL-69499 for further analysis.

from media-driver.

@leyu-yao @XinfengZhang Has there been any progress on this issue?

from media-driver.

@xhaihao do you see any issues for ffmpeg-qsv VP9?

from media-driver.

@Sherry-Lin Yes, I see this issue. The root cause is that VPL runtime doesn't set keyframe flag on returned bitstream.
@warduweram Could you try this WA (intel-media-ci/ffmpeg#701) in FFmpeg ?

from media-driver.

@xhaihao I can try, sure, but I don't know how/where to apply that commit, so if you could give me a hand. :D

from media-driver.

@warduweram you may use the branch directly.
$ git clone https://github.com/xhaihao/ffmpeg-1.git -b wa-qsvenc-vp9

from media-driver.

@xhaihao Thanks for the effort, I appreciate it! I understand correctly that I have to build ffmpeg from that cloned repository, right? It might take me a while, since I haven't built something as complex as ffmpeg before. I might have to boot to Linux or figure out how to do it under Windows. So if there's anyone else with the necessary skills and hardware, feel free to try it out before me.

from media-driver.

I can confirm the fix is working with QSV VP9. Thanks a lot!

from media-driver.

@jnko Awesome, thanks for trying it out, I couldn't manage to compile under Windows.

@Sherry-Lin How do we continue from here, do we communicate this to the ffmpeg team or do you still wanna fix it in the drivers?

from media-driver.

@warduweram The patch was submitted to FFmpeg ML, see https://patchwork.ffmpeg.org/project/ffmpeg/patch/[email protected]/

from media-driver.

@xhaihao Awesome, thanks so much!

from media-driver.

With this commit intel/vpl-gpu-rt@89edcba VPL will set IDR flag (keyframe flag) for VP9 I frames.

from media-driver.

@leyu-yao Thanks so much for the lengthy explanation, I appreciate it! Will the fix work for RaptorLake iGPU?

leyu-yao wrote (on other thread):

I checked windows release driver on . Unfortunately, this is fix is not included yet.
For VPL and Media sdk, they are two runtime in graphics driver. On some new platforms, VPL is used. And media sdk is used on old platforms and it is not maintained anymore.
If you are using recent Intel platforms such as DG2(Arc Axxx) or MTL(Core Ultra xxx), these platforms will use the latest runtime. And this fix will be included the windows release driver in a few weeks. Once you install the driver which includes this fix, a stock ffmpeg build is good to use.
However, if you are using some older platforms, this fix won't benefit the windows release driver and you still need a build ffmpeg with Haihao's patch https://patchwork.ffmpeg.org/project/ffmpeg/patch/[email protected]/ I'm not sure when his ffmpeg patch will be included in some ffmpeg pre-build release. May need comment from Haihao.

from media-driver.

@leyu-yao Thanks so much for the lengthy explanation, I appreciate it! Will the fix work for RaptorLake iGPU?

leyu-yao wrote (on other thread):

I checked windows release driver on . Unfortunately, this is fix is not included yet.
For VPL and Media sdk, they are two runtime in graphics driver. On some new platforms, VPL is used. And media sdk is used on old platforms and it is not maintained anymore.
If you are using recent Intel platforms such as DG2(Arc Axxx) or MTL(Core Ultra xxx), these platforms will use the latest runtime. And this fix will be included the windows release driver in a few weeks. Once you install the driver which includes this fix, a stock ffmpeg build is good to use.
However, if you are using some older platforms, this fix won't benefit the windows release driver and you still need a build ffmpeg with Haihao's patch https://patchwork.ffmpeg.org/project/ffmpeg/patch/[email protected]/ I'm not sure when his ffmpeg patch will be included in some ffmpeg pre-build release. May need comment from Haihao.

Hi @warduweram
As I remember, both VPL and MSDK RT are supported on RaptorLake iGPU. But sorry I'm not very familiar with ffmpeg.
Hi @xhaihao, sorry could you help to comment on this? Which RT will ffmpeg qsv plugin load on RaptorLake?

from media-driver.

This seems to be fixed on 5382 WHQL Intel Arc/Iris drivers with ffmpeg 7.0 on RaptorLake if the right bitrate settings for ffmpeg are chosen, I'll close the issue. Thanks again for all the efforts involved.

from media-driver.