Performance Feedback for Azure SQL MI Linked Service to Synapse Serverless

thracian 121 Reputation points
2021-08-17T15:41:16.737+00:00

Has anyone tried a linked service in Azure SQL MI connected to Synapse Serverless as per the approach in this article? What does performance look like for importing millions of rows from parquet files in ADLS?

Azure SQL Database
0 comments No comments
{count} votes

Accepted answer
  1. Oury Ba-MSFT 16,886 Reputation points Microsoft Employee
    2021-08-18T19:39:26.843+00:00

    Hi @TeoLachev-9086 Thank you for posting your question on Microsoft Q&A.
    What does performance look like for importing millions of rows from parquet files in ADLS?
    We would expect the performance to be affected by the Synapse tier and the network bandwidth, plus the insertion that probably will be single-threaded, but which can be solved through multiple parallel processes.
    Instead of starting one process inserting all the data, split it into multiple processes (SQL Agent Jobs, for example) for potentially achieving better insertion speed. This assumes the abundance of the resources such as Network Bandwidth, Synapse processing power and of course the source file system itself, etc)

    Regards,
    Oury

    1 person found this answer helpful.

1 additional answer

Sort by: Most helpful
  1. thracian 121 Reputation points
    2021-08-19T22:33:59.867+00:00

    Hi Qory,

    It was helpful, thank you. Based on my internal tests, querying a Serverless external table via MI is around x10 slower that using OPENROWSET, which I contribute to performance differences between Polybase and Serverless.

    0 comments No comments