Share via

How to write a file into the VM from ADF

Anonymous 0 Reputation points
2024-03-21T10:28:39.5933333+00:00

Hello community,

I am facing an interesting problem when trying to write to a file share (on-prem) from another folder on the same VM (on-prem) via Self Hosted Integration Runtime (SHIR) in Azure Data Factory (ADF). I have a copy activity that has the source dataset as a file that is on the VM (on-prem) and sink is also on the same VM (on-prem). I get an error saying access to this path is denied. I installed SHIR on the VM and have verified that I am the owner of the folder that I'm trying to write to. I am unsure of the issue or problem. Can someone help me troubleshoot this problem?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions
0 comments

3 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. phemanth 8,645 Reputation points Microsoft Vendor
    2024-03-25T05:15:16.0833333+00:00

    @Anonymous Welcome to Microsoft Q&A platform and thanks for posting your question.

    I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others "I'll repost your solution in case you'd like to accept the answer.

    Ask: I am facing an interesting problem when trying to write to a file share (on-prem) from another folder on the same VM (on-prem) via Self Hosted Integration Runtime (SHIR) in Azure Data Factory (ADF). I have a copy activity that has the source dataset as a file that is on the VM (on-prem) and sink is also on the same VM (on-prem). I get an error saying access to this path is denied. I installed SHIR on the VM and have verified that I am the owner of the folder that I'm trying to write to. I am unsure of the issue or problem. Can someone help me troubleshoot this problem?

    Solution: I have tried all these and also had recreated the folder with the account that I am using to connect to VM. Finally, what worked was I had changed the IP value to VM name on the linked service. For some strange reason, this had worked.

    If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.

    If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.

    Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

    1 person found this answer helpful.
    0 comments
  2. Dillon Silzer 56,681 Reputation points
    2024-03-22T01:18:31.0666667+00:00

    Hello,

    I would recommend trying to run the following commands as Administrator on the VM(s):

    .\dmgcmd.exe -EnableLocalMachineAccess

    or

    .\dmgcmd.exe -DisableLocalFolderPathValidation

    Cited from https://stackoverflow.com/questions/76101174/access-denied-to-server-in-file-system-linked-service-in-data-factory

    More information:

    Set up an existing self-hosted IR via local PowerShell

    https://learn.microsoft.com/en-us/azure/data-factory/create-self-hosted-integration-runtime?tabs=data-factory#set-up-an-existing-self-hosted-ir-via-local-powershell

    If this is helpful please accept answer.

    0 comments
  3. Anonymous 0 Reputation points
    2024-03-22T09:58:09.4433333+00:00

    I have tried all these and also had recreated the folder with the account that I am using to connect to VM. Finally, what worked was I had changed the IP value to VM name on the linked service. For some strange reason, this had worked.