Hi there,
This error might be caused by one of the following conditions, check the below points and see if they help you in getting over the installation.
-The Remote Registry service is not running on a remote system.
-The File and Printer Sharing firewall exception is not enabled on a remote system running Windows Vista.
-The application is running as a user with insufficient privileges.
Also, ensure that firewall ports required by RDS are open.
http://social.technet.microsoft.com/wiki/contents/articles/16164.which-ports-are-used-by-a-rds-2012-deployment.aspx
The below thread discusses the same issue and you can try out some troubleshooting steps from this and see if that helps you to sort the Issue.
Installing of Remote Desktop Connection Broker fail because of firewall rule https://social.technet.microsoft.com/Forums/ie/en-US/054619f2-e1b5-4c09-8199-d9b93fcd7102/installing-of-remote-desktop-connection-broker-fail-because-of-firewall-rule?forum=winserverTS
--If the reply is helpful, please Upvote and Accept it as an answer–