How to write a file into the VM from ADF

Question

Hello community,

I am facing an interesting problem when trying to write to a file share (on-prem) from another folder on the same VM (on-prem) via Self Hosted Integration Runtime (SHIR) in Azure Data Factory (ADF). I have a copy activity that has the source dataset as a file that is on the VM (on-prem) and sink is also on the same VM (on-prem). I get an error saying access to this path is denied. I installed SHIR on the VM and have verified that I am the owner of the folder that I'm trying to write to. I am unsure of the issue or problem. Can someone help me troubleshoot this problem?

Answer 1

@Anonymous Welcome to Microsoft Q&A platform and thanks for posting your question.

I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others "I'll repost your solution in case you'd like to accept the answer.

Ask: I am facing an interesting problem when trying to write to a file share (on-prem) from another folder on the same VM (on-prem) via Self Hosted Integration Runtime (SHIR) in Azure Data Factory (ADF). I have a copy activity that has the source dataset as a file that is on the VM (on-prem) and sink is also on the same VM (on-prem). I get an error saying access to this path is denied. I installed SHIR on the VM and have verified that I am the owner of the folder that I'm trying to write to. I am unsure of the issue or problem. Can someone help me troubleshoot this problem?

Solution: I have tried all these and also had recreated the folder with the account that I am using to connect to VM. Finally, what worked was I had changed the IP value to VM name on the linked service. For some strange reason, this had worked.

If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.

If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.

---

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

Answer 2

Hello,

I would recommend trying to run the following commands as Administrator on the VM(s):

.\dmgcmd.exe -EnableLocalMachineAccess

or

.\dmgcmd.exe -DisableLocalFolderPathValidation

Cited from https://stackoverflow.com/questions/76101174/access-denied-to-server-in-file-system-linked-service-in-data-factory

More information:

Set up an existing self-hosted IR via local PowerShell

https://learn.microsoft.com/en-us/azure/data-factory/create-self-hosted-integration-runtime?tabs=data-factory#set-up-an-existing-self-hosted-ir-via-local-powershell

If this is helpful please accept answer.

Answer 3

I have tried all these and also had recreated the folder with the account that I am using to connect to VM. Finally, what worked was I had changed the IP value to VM name on the linked service. For some strange reason, this had worked.