How can data be securely stored in a PostgreSQL database within a private network using data flows?

Stalin Jose 0 Reputation points

After transforming the data using data flows, I encountered an issue when attempting to copy it to my Postgres database. This challenge arose as my database is hosted within a private Azure virtual network, and my initial approach of using a Self Host Runtime proved incompatible with dataflows.

To overcome this hurdle and successfully transfer my transformed data to the database, I'd like to explore alternative methods or technologies.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,062 questions
{count} votes

1 answer

Sort by: Most helpful
  1. SatishBoddu-MSFT 18,771 Reputation points

    Hello @Stalin Jose Welcome to QnA forum.

    If the PostgreSQL database is configured to allow connections from the private endpoint , Did you try the Sink transformation settings, specifying the connection string for your PostgreSQL database using the private endpoint?

    If your initial approach of using a Self Hosted Integration Runtime (IR) proved incompatible with data flows, you can use Azure Integration Runtime (IR) instead.

    • Create an Azure IR in the same region as your ADF instance and your PostgreSQL database
    • Add the IP address of the Azure IR to the firewall rules of your PostgreSQL server.
    • In the sink transformation settings, specify the connection string for your PostgreSQL database using the Azure IR.
    0 comments No comments