IBasicVideoEffect and MediaPlaybackList

mcosmin 1

I have a MediaPlaybackList and a IBasicVideoEffect.

I add the effect onto a MediaPlayer object before setting the MediaPlaybackList as source (due to obvious reasons).

Now the catch is, the MediaPlaybackList sometimes skips PlaybackItems at random, sometimes as many as 4 in a row. It simply reports "Error" as the reason for changing the item. Often times I can view as many as 8-9 videos gaplessly, and then the MediaPlaybackList simply decides to skip a bunch, and then go on and play a few videos like nothing happened.

This seems to be related to the IBasicVideoEffect, but I don't understand how.

Are there any special considerations when doing this combination? Is the IBasicVideoEffect not designed to work with MediaPlaybackList? Is there a way to track down the "Error" reported by MediaPlaybackList as reason for changing the item?

Additional error info seems to be

A valid type has not been set for this stream or a stream that it depends on. (Exception from HRESULT: 0xC00D6D60)

More info: I am adding media playback items into the list dynamically. This seems to have an impact, as adding a new list will call Close/SetEncodingProperties again.

https://social.msdn.microsoft.com/Forums/en-US/6a8b41ee-71ad-4e83-8e76-f25ba8de327a/uwp-any-special-considerations-when-using-ibasicvideoeffect-with-mediaplaybacklist?forum=wpdevelop

repo sample

https://aka.ms/AA53ab2

1 answer

James Dailey - MSFT 336 Reputation points Microsoft Employee

2020-01-27T19:01:24.607+00:00

The problem is likely due to a media type mismatch between the video effect and the next file in the list. I'm going to wager that when files get skipped they have a different format, resolution, etc. than the first file in the list that played correctly. This is probably because the video effect rigidly sets it's media type and then isn't responding to the dynamic format change, rejecting the media type of the new file in the list.

I would recommend debugging the video effect and making sure that the plug-in is responding to media type changes properly.

If you think I'm missing something let me know.
Please sign in to rate this answer.
mcosmin222 1 Reputation point

2020-01-28T05:51:51+00:00

The issue happens randomly. I cannot find any weird issues with the effect. I only set the subtype of the encoding profile to ARBG32, as instructed here, to catch all types of video files

https://learn.microsoft.com/en-us/windows/uwp/audio-video-camera/custom-video-effects

It even reproduces with a read-only filter which just passes the video frames through unaltered, just to rule out any weird bugs in my implementation.

Please help. This is a breaking issue for us.

The files are all the same encoding. This has something to do with the media playback list, cause individually the files play fine.

OP is stuck in a login loop, so I made a new account.

mcosmin222 1 Reputation point

2020-01-31T17:11:18.32+00:00

So, any updates? It's been over 6 months. Perhaps we should give up on UWP as a viable media platform?

James Dailey - MSFT 336 Reputation points Microsoft Employee

2020-02-22T02:45:34.117+00:00

Haven't been getting email notifications on my answered questions.

Remember if the consumer of your effect can't encode video using the properties you specify, it will call Close on your effect and the video pipeline will be reset. The argument to the Close method is a MediaEffectClosedReason that lets you know whether the effect was closed normally, if an error occurred, or if the effect does not support the required encoding format. Do you see Close being called on your effect? Not all MF sources and not all sinks can support ARGB32. The NV12 format is the one that is most widely supported as it is a requirement by the OS.

If you still need help you can get in touch with me directly by opening a ticket by going to: http://aka.ms/storesupport Click on "contact us" and then select "Windows 10 UWP app development".

-James

mcosmin222 1 Reputation point

2020-02-22T17:59:43.627+00:00

The close reason is always "done". Even if the video stream is always nv12, it still gives the errors randomly. I will use the contact link you sent when I have more time for this.

Thanks.

James Dailey - MSFT 336 Reputation points Microsoft Employee

2020-02-25T23:32:51.32+00:00

Sounds good. Based on your previous comment I think I'm going to need a MF trace to help you diagnose further. That's not something you should be providing publicly. If you want to take a look at the MF trace data yourself you can check out the MXA tool: http://www.microsoft.com/en-us/download/details.aspx?id=43105. You won't get the full picture because you won't have the private symbols but it might be worth a look. It's a great tool for diagnosing MF issues.

mcosmin222 1 Reputation point

2020-03-05T19:21:42.603+00:00

So I recorded a repro using Windows performance Recorder. Should I sent it over to you?

James Dailey - MSFT 336 Reputation points Microsoft Employee

2020-03-10T21:16:20.087+00:00

Please don't make it public. Traces collected by WPR will likely contain private information and should not be shared publicly. Go ahead and open a ticket using the link above and put my name in it. I'll pick it up and send you a link to a secure file transfer portal. We can then work together to figure out why things aren't working.

mcosmin222 1 Reputation point

2020-03-16T07:46:31.783+00:00

Unfortunately I cannot get past the subscription part. Is there any other way I can send this dump to you?

James Dailey - MSFT 336 Reputation points Microsoft Employee

2020-03-17T00:51:48.503+00:00

Try logging in with a different email address. Something like your personal Microsoft account should work. There is an issue with opening a ticket if your email address is associated with AAD. We are trying to get it fixed. Sorry about that.

mcosmin 1 Reputation point

2020-05-22T14:18:30.127+00:00

Well, here I am back again.
I had another look at this, and we will have to find another way of getting the debug data over to you. The app is free and I don't feel like spending 500$ dollars on this troubleshooting :(
Sign in to comment