winrt::Windows::Graphics::Capture API on DirectX12

Question

winrt::Windows::Graphics::Capture API on DirectX12

mzlt666 1

I am trying to capture my monitor from a DirectX12 application using the Windows Runtime Capture API.
I tried doing this in two ways so far:

approach 1: use the D3D11On12CreateDevice function to create ID3D11Device and use that device to get the IDXGIDevice and CreateDirect3D11DeviceFromDXGIDevice from there.
Problem: in this situation the FrameArrived callback only gets called the exact amount of times as the number of declared buffers in the winrt::Windows::Graphics::Capture::Direct3D11CaptureFramePool::Create function. i.e. if the number of buffers is 2 it will only capture 2 frames.
approach 2: create new Device from the adapter using the use the D3D11CreateDevice function to create ID3D11Device and use that device to get the IDXGIDevice and CreateDirect3D11DeviceFromDXGIDevice from there. Also use the D3D11On12CreateDevice function to be able to copy the ID3D11Texture2D Texture into the Wrapped ID3D12Resource Resource.
Problem: in this situation the FrameArrived callback behaves as expected but the texture I copy into my wrapped resource is transparent. (I can correctly receive the Width, Height and PixelFormat of the texture but after the copy is performed into my wrapped resource the Render Target is still in it's clear colour).

Is there a better/ tested way of approaching this?

Any help would be great!

Nico Zhu (Shanghai Wicresoft Co,.Ltd.) 12,826 Reputation points

2022-08-18T06:55:18.217+00:00

Please refer to official document, you need to re-call TryGetNextFrame method request the following frames, then invoke arrive event again and again.

mzlt666 1

I do call the TryGetNextFrame method.

My constructor looks as follows:

WinRTCapture::WinRTCapture(  
	winrt::Windows::Graphics::DirectX::Direct3D11::IDirect3DDevice const& InitDevice,  
	winrt::Windows::Graphics::Capture::GraphicsCaptureItem const& InitItem,  
	winrt::Windows::Graphics::DirectX::DirectXPixelFormat InitPixelFormat  
)  
{  
	Device = InitDevice;  
	Item = InitItem;  
	PixelFormat = InitPixelFormat;  
  
	FramePool = winrt::Windows::Graphics::Capture::Direct3D11CaptureFramePool::Create(Device, PixelFormat, 2, Item.Size());  
	Session = FramePool.CreateCaptureSession(Item);  
	LastSize = Item.Size();  
	FramePool.FrameArrived({ this, &WinRTCapture::OnFrameArrived });  
  
	WINRT_ASSERT(m_session != nullptr);  
}

and than my callback looks like this:

void WinRTCapture::OnFrameArrived(  
	winrt::Windows::Graphics::Capture::Direct3D11CaptureFramePool const& Sender,  
	winrt::Windows::Foundation::IInspectable const& Args  
)  
{  
	winrt::Windows::Graphics::Capture::Direct3D11CaptureFrame Frame = Sender.TryGetNextFrame();  
	winrt::com_ptr<ID3D11Texture2D> Texture = GetDXGIInterfaceFromObject<ID3D11Texture2D>(Frame.Surface());  
	winrt::Windows::Graphics::SizeInt32 const ContentSize = Frame.ContentSize();  
  
	NewFrame.Broadcast(Texture.get());  
  
	if ((ContentSize.Width != LastSize.Width)  
		|| (ContentSize.Height != LastSize.Height))  
	{  
		LastSize = ContentSize;  
		FramePool.Recreate(Device, PixelFormat, 2, LastSize);  
	}  
}

mzlt666 1 Reputation point

2022-08-18T10:19:16.287+00:00

Also yo make it clear the program runs without issues in directx11 environment. this only pops up in directx12...
Nico Zhu (Shanghai Wicresoft Co,.Ltd.) 12,826 Reputation points

2022-08-19T01:41:57.233+00:00

The problem more related with dx12 environment, can you provide a mini repro sample for us, I will discuss with team to check if it is know issue.
mzlt666 1 Reputation point

2022-08-19T16:23:44.65+00:00
Please find here a little project illustrating the issue with approach 1: https://github.com/Off-World-Live/d3d11on12CaptureTest
The project is a quick implementation on top of the directX12 HelloTexture project.
It doesn't actually render anything of interest, but the information is illustrated in the debug console which runs when we execute the build.
It shows that the OnFrameArrived is only being called the exact number of times that the NumBuffers specified in the WinRTCapture.h.

Most of the relevant code is inside the WinRTCapture class, but the other important parts are

Creation of relevant devices (d3d11on12 and Interop devices) (lines 99-125 in D3D12HelloTexture.cpp)

Initialisation of the Graphics Capture (lines 347-352 in D3D12HelloTexture.cpp)
Nico Zhu (Shanghai Wicresoft Co,.Ltd.) 12,826 Reputation points

2022-08-22T01:20:07.157+00:00

Got it, I will discuss with team, If any updates I will share below.
Campbell Morgan 1 Reputation point

2022-09-12T13:34:18.297+00:00

Any updates on this?

Nico Zhu (Shanghai Wicresoft Co,.Ltd.) 12,826 Reputation points

2022-08-18T06:55:18.217+00:00

Please refer to official document, you need to re-call TryGetNextFrame method request the following frames, then invoke arrive event again and again.
mzlt666 1 Reputation point

2022-08-18T09:04:13.05+00:00

I do call the TryGetNextFrame method.

My constructor looks as follows:

WinRTCapture::WinRTCapture( winrt::Windows::Graphics::DirectX::Direct3D11::IDirect3DDevice const& InitDevice, winrt::Windows::Graphics::Capture::GraphicsCaptureItem const& InitItem, winrt::Windows::Graphics::DirectX::DirectXPixelFormat InitPixelFormat ) { Device = InitDevice; Item = InitItem; PixelFormat = InitPixelFormat; FramePool = winrt::Windows::Graphics::Capture::Direct3D11CaptureFramePool::Create(Device, PixelFormat, 2, Item.Size()); Session = FramePool.CreateCaptureSession(Item); LastSize = Item.Size(); FramePool.FrameArrived({ this, &WinRTCapture::OnFrameArrived }); WINRT_ASSERT(m_session != nullptr); }

and than my callback looks like this:

void WinRTCapture::OnFrameArrived( winrt::Windows::Graphics::Capture::Direct3D11CaptureFramePool const& Sender, winrt::Windows::Foundation::IInspectable const& Args ) { winrt::Windows::Graphics::Capture::Direct3D11CaptureFrame Frame = Sender.TryGetNextFrame(); winrt::com_ptr<ID3D11Texture2D> Texture = GetDXGIInterfaceFromObject<ID3D11Texture2D>(Frame.Surface()); winrt::Windows::Graphics::SizeInt32 const ContentSize = Frame.ContentSize(); NewFrame.Broadcast(Texture.get()); if ((ContentSize.Width != LastSize.Width) || (ContentSize.Height != LastSize.Height)) { LastSize = ContentSize; FramePool.Recreate(Device, PixelFormat, 2, LastSize); } }
mzlt666 1 Reputation point

2022-08-18T10:19:16.287+00:00

Also yo make it clear the program runs without issues in directx11 environment. this only pops up in directx12...
Nico Zhu (Shanghai Wicresoft Co,.Ltd.) 12,826 Reputation points

2022-08-19T01:41:57.233+00:00

The problem more related with dx12 environment, can you provide a mini repro sample for us, I will discuss with team to check if it is know issue.
mzlt666 1 Reputation point

2022-08-19T16:23:44.65+00:00

Please find here a little project illustrating the issue with approach 1: https://github.com/Off-World-Live/d3d11on12CaptureTest
The project is a quick implementation on top of the directX12 HelloTexture project.
It doesn't actually render anything of interest, but the information is illustrated in the debug console which runs when we execute the build.
It shows that the OnFrameArrived is only being called the exact number of times that the NumBuffers specified in the WinRTCapture.h.

Most of the relevant code is inside the WinRTCapture class, but the other important parts are

Creation of relevant devices (d3d11on12 and Interop devices) (lines 99-125 in D3D12HelloTexture.cpp)

Initialisation of the Graphics Capture (lines 347-352 in D3D12HelloTexture.cpp)
Nico Zhu (Shanghai Wicresoft Co,.Ltd.) 12,826 Reputation points

2022-08-22T01:20:07.157+00:00

Got it, I will discuss with team, If any updates I will share below.
Campbell Morgan 1 Reputation point

2022-09-12T13:34:18.297+00:00

Any updates on this?

winrt::Windows::Graphics::Capture API on DirectX12

Activity