Hi,
- First make sure you can actually ping the target from host.
- Next, check the dbgsettings and the port using "bcdedit /dbgsettings" on the target. Make sure you've used the correct key on the host.
- Lastly, Make sure you have WDK installed on your target (test) machine as well (WDK needs to be installed on both host and target machine if you want to provision the target machine for Driver deployment. However, Kernel Debugging works without WDK on the target). You need to install WDK on target and then run "WDK Test Target Setup x64-x64_en-us.msi" file on the target. After that you will be able to setup the target machine for provisioning from Visual Studio on your host machine. "WDK Test Target Setup x64-x64_en-us.msi" file will be located somewhere around "C:\Program Files (x86)\Windows Kits\10\Remote\x64" path on your target machine after WDK is installed.
I was having the same errors as you but I hadn't followed the 3rd step (in this answer) correctly.
Here are the detailed steps: https://learn.microsoft.com/en-us/windows-hardware/drivers/gettingstarted/provision-a-target-computer-wdk-8-1