What is the use case if we need need delta lake (Gold Layer) and Synapse SQL Dedicated Pools(DWH)

Question

Reference: https://techcommunity.microsoft.com/t5/azure-synapse-analytics-blog/building-the-lakehouse-implementing-a-data-lake-strategy-with/ba-p/3612291?lightbox-message-images-3625242=404398i228E30C28E43688A

I am confused, do we really need dedicated pools ? Wondering if there is any real time scenario

Answer 1

Hello @Shuvendu Kumar Das ,

Thanks for the question and using MS Q&A platform.

In general, Synapse Dedicated SQL Pools, which are provisioned, massively parallel processing (MPP) database engines designed to serve as the main serving layer (common modern data warehouse pattern).

In Lakehouse pattern however, we don’t use a Dedicated SQL Pool. Instead, we leverage the Serverless SQL Pool. These are ideal for Lakehouse as they’re pay-per-query, not always-on compute, and they essentially work by creating a T-SQL layer on top of the data lake, allowing you to write queries and create external objects on the lake that external tools can then consume.

• What is the use case if we need need delta lake (Gold Layer) and Synapse SQL Dedicated Pools(DWH). I am confused, do we really need dedicated pools ? Wondering if there is any real time scenario - Dedicated pools are very useful with performance requirements and features such as native row level security/column masking are a necessity. This rule out the serverless SQL pool as it is only supported in Dedicated pools. The Dedicated SQL pool can be utilized for specific workloads where performance requirements are well understood and require an optimized compute strategy.

Hope this info helps.

Thank you