Sounds like a task or application is running in the background and causing explorer to freeze. Also may want to disable antivirus to see if that is causing explorer to freak out.
RDP uses both UDP and TCP protocols on port 3389. RDP protocol started using UDP from RDP v8 which was released in Windows 8 and Server 2012. The purpose of UDP is to make the connection faster and improve user experience.
Open group policy editor
Expand Computer Configuration > Administration Templates > Windows Components > Remote Desktop Services > Remote Desktop Connection Client. Double click the setting “Turn Off UDP On Client”. Choose Enabled option to enable this setting. Click Apply to apply the change.
Hope this resolves your Query !!
--If the reply is helpful, please Upvote and Accept it as an answer--