[UWP] how to set video source of media player as frame of Platform::Array<uint8> captured by UDP communication

WooHyun Ahn 1

Hi.

I'm modifying a 360VideoPlayback projects of UWP samples to play video frames captured by custom UDP communication.

Video frames of UYVY format are stored in variable of Platform::Array<uint8> every 33 ms (about 1/30fps). Then, how can I feed these frames into Media Player?

I found this tutorial, but it seems that only real device can be used as media source.

https://learn.microsoft.com/en-us/windows/uwp/audio-video-camera/process-media-frames-with-mediaframereader#use-mediasource-to-display-frames-in-a-mediaplayerelement

Now, I'm trying as follows

static Windows::Media::Playback::MediaPlayer^ m_mediaPlayer;

// How to assignvariable of Platform::Array<uint8> into mediaFrameSource ??

Frames::MediaFrameSource^ mediaFrameSource;
MediaSource^ source = MediaSource::CreateFromMediaFrameSource(mediaFrameSource);

m_mediaPlayer->MediaOpened += ref new TypedEventHandler<MediaPlayer^, Object^>(this, &AppView::OnMediaOpened);
m_mediaPlayer->Source = source;

Thanks in advance

Roy Li - MSFT 32,051 Reputation points Microsoft Vendor

2022-09-29T06:53:22.423+00:00

Could you please tell me if you are trying to play the data live? If not, would you like to save it as a file locally and then play it?
WooHyun Ahn 1 Reputation point

2022-09-29T10:49:44.34+00:00

live!

I think the way above looks impossible, so other example is being considered to display frame data on screen.

https://github.com/microsoft/Windows-universal-samples/tree/main/Samples/CameraFrames

Furthermore, I will try RTSP protocol for media player, but I am little worried about delay between sender and receiver would be increased. The delay under 300 msec is my goal.
Roy Li - MSFT 32,051 Reputation points Microsoft Vendor

2022-09-30T06:50:36.267+00:00

If you could use stream for live video playing, you could consider using Adaptive streaming in UWP. But here is one thing you might need to notice, the Adaptive streaming only support Http Live Streaming (HLS) and Dynamic Streaming over HTTP (DASH) content.