I'm setting up data factory to move data from cosmos db to blob using data flow. For security reasons, cosmos db only allows access via private endpoints. Managed private endpoint is created in df and is approved to access cosmos db. The connection works with "Test Connection" and I'm able to preview data in different steps of the data flow. However, when I debug or trigger the data flow activity in a pipeline, an error tells me it's trying to access CosmosDB from a public IP and can't access through the firewall. I don't understand why it's public ip even though I'm using private endpoint to access cosmos db. What's interesting is this issue only occurs when I use data flow. The pipeline works fine if I replace the data flow activity with copy activity (using same datasets). Someone posted a similar question on so: https://stackoverflow.com/questions/69630596/data-factory-endpoint-trouble
Any ideas what't going wrong?