SFTP Requirement

Question

Hello Team,

I want to access the files from the SFTP drive and read the the file and upload into azure sql database via azure data factory pipeline.

I tired to find the good document. But not able to find. Please any one can share the suitable link to me.

I have file in pn_hosp.txt.gz

Is there any dataset is compatible for compressed one

Thanks in advance

Rohit

Answer 1

Hello Rohit Kulkarni,

To move data from an SFTP server to Azure SQL Database via Azure Data Factory pipeline, you can use the Copy Activity in Azure Data Factory.

You can find the detailed steps in this document: https://learn.microsoft.com/en-us/azure/data-factory/connector-sftp?tabs=data-factory

For your specific file format, pn_hosp.txt.gz, you can use the GZip compression codec

You can find more details here: https://learn.microsoft.com/en-us/azure/data-factory/supported-file-formats-and-compression-codecs

https://learn.microsoft.com/en-us/azure/data-factory/connector-sftp?tabs=data-factory#dataset-properties

I hope this helps. Please let me know if you have any further questions.