Issue connecting to On Premise server File system from Data Factory Linked Services

Question

Issue connecting to On Premise server File system from Data Factory Linked Services

Balswam 10

Linked Service connection to On-Premise file system fails. Below is the error message

The value of the property '' is invalid: 'Access to XX.X.X.X is denied, resolved IP address is XX.X.X.X, network type is OnPremise'.

Access to XX.X.X.X is denied, resolved IP address is XX.X.X.X, network type is OnPremise

Activity ID: 9c8cfdd4-f9e0-4788-a3ec-00809d82f81c.

Here is the event viewer log from the On-Premise server. Pipeline has been failing for the last 3 days.

message: TestConnection failed, error message: 'Type=Microsoft.DataTransfer.SecurityValidation.Exceptions.HostValidationException,Message=Access to XX.X.X.X is denied, resolved IP address is XX.X.X.X, network type is OnPremise,Source=Microsoft.DataTransfer.SecurityValidation,StackTrace=   at Microsoft.DataTransfer.SecurityValidation.HostValidator.HandleDisallowedHostWithLogging(Action`1 writeLog, Boolean throwException, Tuple`3 args, Boolean isOnPrem)
   at Microsoft.DataTransfer.SecurityValidation.HostValidator.IsAllowedHost(String host, NetworkType networkType, Boolean enableLocalMachineAccessFromOnPremise, Action`1 writeAccessDeniedLog, Action`1 writeDnsFailureLog, Boolean throwExceptionUponValidationFailure)
   at Microsoft.DataTransfer.SecurityValidation.HostValidator.IsAllowed(String hostOrUri, NetworkType networkType, Boolean enableLocalMachineAccessFromOnPremise, Action`1 writeAccessDeniedLog, Action`1 writeDnsFailureLog, Boolean throwExceptionUponValidationFailure)
   at Microsoft.DataTransfer.Common.HostValidationRuntimeCommonHelper.ValidateHostWithLogging(String host, Guid jobId, Guid activityId, ComputeType computeType, Boolean enableLocalMachineAccessFromOnPremise, Boolean disableLocalFolderPathValidation, Boolean throwExceptionUponValidationFailure, Boolean supportLocalFolderPathValidation, Boolean shouldValidateFolderPath)
   at Microsoft.DataTransfer.Runtime.FileServerConnectionSettings..ctor(IDictionary`2 properties, Boolean skipHostValidation)
   at Microsoft.DataTransfer.Runtime.FileServerConnection..ctor(IDictionary`2 properties)
   at Microsoft.DataTransfer.Runtime.FileServerConnector.CreateConnection(IDictionary`2 properties)
   at Microsoft.DataTransfer.Runtime.Provider.HybridRuntimeConnection.Initialize(ConnectionSetting connectionSettings, PluginRegistration plugins, String dataFactoryName, String dataFactoryId, String dataFactoryRegionAbbrev, String linkedIRCredential, AzureCloudType azureCloudType, String miStoreVersion, DataTransferCredentials credentials)
   at Microsoft.DataTransfer.Runtime.Provider.HybridRuntimeConnection..ctor(ConnectionSetting connectionSettings, PluginRegistration plugins, IMemoryLimit memoryLimit, String dataFactoryName, String dataFactoryId, String dataFactoryRegionAbbrev, String linkedIRCredential, AzureCloudType azureCloudType, String miStoreVersion, DataTransferCredentials credentials)
   at Microsoft.DataTransfer.TransferTask.InteractiveTaskFactoryV2.ConnectorTestConnection(ConnectionSetting connectionSetting, TestConnectionV2Response response)
   at Microsoft.DataTransfer.TransferTask.InteractiveTaskFactoryV2.TestConnection(TestConnectionV2Request request, TestConnectionV2Response response, CancellationToken token)
   at Microsoft.DataTransfer.TransferTask.InteractiveTask`2.Execute(),'.

Vinodh247 34,661 Reputation points MVP Volunteer Moderator

2023-06-26T01:03:32.5666667+00:00

Hi,

Thanks for reaching out to Microsoft Q&A.

Verify if your incoming(azure) is whitelisted. The error describes that it is blocking with access denied error. Are you able to create a new linked service and test?

Please Upvote and Accept as answer if the reply was helpful, this will be benefitting the other community members who go through the same issue.
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2023-06-26T09:31:25.7166667+00:00

@Balswam - Thanks for the question and using MS Q&A platform.

Could you please share the information on the linked service type which you are using along with the screenshot of the error message where you are seeing it?
Balswam 10 Reputation points

2023-06-27T02:52:41.8866667+00:00

@PRADEEPCHEEKATLA Linked service is file system. Please see below screenshot. Thanks in advance.
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2023-07-06T08:38:14.5933333+00:00

@Balswam - Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

Your answer

Vinodh247 34,661 Reputation points MVP Volunteer Moderator

2023-06-26T01:03:32.5666667+00:00

Hi,

Thanks for reaching out to Microsoft Q&A.

Verify if your incoming(azure) is whitelisted. The error describes that it is blocking with access denied error. Are you able to create a new linked service and test?

Please Upvote and Accept as answer if the reply was helpful, this will be benefitting the other community members who go through the same issue.
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2023-06-26T09:31:25.7166667+00:00

@Balswam - Thanks for the question and using MS Q&A platform.

Could you please share the information on the linked service type which you are using along with the screenshot of the error message where you are seeing it?
Balswam 10 Reputation points

2023-06-27T02:52:41.8866667+00:00

@PRADEEPCHEEKATLA Linked service is file system. Please see below screenshot. Thanks in advance.
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2023-07-06T08:38:14.5933333+00:00

@Balswam - Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 1

PRADEEPCHEEKATLA 90,641 Moderator

@Balswam - Thanks for additional details.

According to the offical documentation, the latest SHIR has a security fix that has been changed and does not allow access to local files by default.

User's image

You must run .\dmgcmd.exe -DisableLocalFolderPathValidation to disable the setting for more details, refer to Set up an existing self-hosted IR via local PowerShell

User's image

For more details, refer to Access denied to server in File System Linked Service in Data Factory.

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Marc Scirri 41 Reputation points

2023-06-27T20:20:29.08+00:00
I followed these steps and I am still having the same issue. Does it require a system reboot?

I did restart the SHIR after running that PS command and still nothing. My folks are telling me that nothing changed and these linked services worked last week.

I have tried:

\serverName\shareName\

\serverName\C$\folderName\

C:\folderName\

I changed my SHIR to a network account that is local admin and has explicit permissions on the share and the folders. The credentials I am providing in the linked service also are local admin on the server.
Anonymous

2023-07-23T23:34:27.4833333+00:00

I have the same exact issue and running the DisableLocalFolderPathValidation command did not help. I even uninstalled SHIR version 5.30 and went back to 5.29 - no change.

Any other ideas?

Update:

I needed to open powershell as administrator and it worked this time. Thank you guys!
Marc Scirri 41 Reputation points

2023-07-25T14:55:50.02+00:00

I had PS opened as admin and it still didn't work. I am glad you got it working. Hopefully that means it is just our environment.

Share via

Issue connecting to On Premise server File system from Data Factory Linked Services

1 answer

Your answer