Can I use DataFactory to access a 3rd party data file and pull it into Azure?

Ed Hickey 11 Reputation points
2022-04-04T15:10:31.36+00:00

I am investigating DataFactory. I have a 3rd party who happens to be in the same Azure region. They will be creating a file that I need to process in my Azure tenant. I was hoping that through the DataFactory pipeline that I would be able to connect to the external directory using their provided credentials and pull that into my blob storage, then process the file updating my cosmosDB.

Traditionally, we would use an inhouse SFTP service and connect securely to the 3rd party. Pull the file, place the file on our side, then have a pre-written script to pull the records from the file and update the database.189824-rbn4zbv.png]189859-r93bh1y.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,605 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Ed Hickey 11 Reputation points
    2022-04-04T15:20:20.427+00:00

    I finally found a reference: Looks like for both SFTP and an external file system, it is possible. These are considered source. The link https://learn.microsoft.com/en-us/azure/data-factory/connector-file-system?tabs=data-factory shows both a file system and SFTP as supportable data sources.

    https://learn.microsoft.com/en-us/azure/data-factory/connector-file-system?tabs=data-factory

    https://learn.microsoft.com/en-us/azure/data-factory/connector-sftp?tabs=data-factory

    2 people found this answer helpful.
    0 comments No comments