Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,122 questions
Azure Data Factory - Sink dataflow error
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 28.000000000000004%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPM%3C/text%3E%3C/svg%3E)
Prasad M
0
Reputation points
Hello ,
i was trying to connect SFTP connection to the Sink data flow and in directory i gave the path and it was throwing error as
Job failed due to reason: at Sink 'sink1': Can't make directory for path ".spark-staging-" under "".
i have tried parameter's and other options but still same error.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 48%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
Harishga 5,910 Reputation points Microsoft Vendor2024-07-01T05:23:43.69+00:00 Hi @Prasad M
Welcome to Microsoft Q&A platform and thanks for posting your question here.It looks like you’re having trouble with Azure Data Factory when trying to create a directory in the SFTP sink. The error message suggests that the system can’t create the necessary staging directory.
First, make sure the SFTP user has permission to create directories and write files in the specified path. Check that the directory path you provided is correct and accessible. Sometimes, incorrect paths can cause issues. Try creating the directory manually on the SFTP server using the same user credentials. If this works, it might be a configuration issue with the Data Flow.
Also, ensure that the integration runtime in your data flow is properly configured and has the necessary network access to the SFTP server. Use the debug mode in Azure Data Factory to get more detailed error messages, which can help identify the exact problem.
I hope this information helps you. Let me know if you have any further questions or concerns.
-
Harishga 5,910 Reputation points Microsoft Vendor
2024-07-02T12:41:14.0633333+00:00 @Prasad M
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help. -
Harishga 5,910 Reputation points Microsoft Vendor
2024-07-03T03:59:42.6533333+00:00 @Prasad M
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Sign in to comment