How to measure data processed with dedicated sql pool?

Question

How to measure data processed with dedicated sql pool?

Cody Dance 0

My client currently uses a dedicated SQL pool in Azure Synapse and we are trying to assess the possible cost savings from switching to a serverless SQL pool. The pricing for the serverless SQL pool is per TB of data processed. Is there a way to measure the amount of data processed in a dedicated SQL pool?

Vinodh247 34,661 Reputation points MVP Volunteer Moderator

2023-11-16T07:13:41.7866667+00:00

Just checking if you had a chance to look at this. If so, can you please update?
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
Cody Dance 0 Reputation points

2023-11-16T19:23:11.75+00:00

@Vinodh247 Hi Vinhodh. Yes, I have looked at everything but the question has still not been answered.
phemanth 15,755 Reputation points Microsoft External Staff Moderator

2023-11-21T06:28:49.1933333+00:00

@Cody Dance

However, you can estimate the cost of the serverless SQL pool based on the amount of data processed by your dedicated SQL pool. One way to do this is to use the Query Store feature in Azure Synapse Analytics to capture the amount of data processed by each query in your dedicated SQL pool. You can then use this data to estimate the amount of data that will be processed in the serverless SQL pool and calculate the cost based on the pricing model.

Another way to estimate the cost of the serverless SQL pool is to use the Azure Synapse Analytics pricing calculator. The pricing calculator allows you to estimate the cost of the serverless SQL pool based on the amount of data processed, the number of queries, and other factors. You can use this tool to get an estimate of the cost of the serverless SQL pool based on your current workload.

I hope these steps help you resolve the issue. If you have any further questions or concerns, please let us know.
phemanth 15,755 Reputation points Microsoft External Staff Moderator

2023-11-22T11:45:57.84+00:00

@Cody Dance

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

1 answer

Your answer

Vinodh247 34,661 Reputation points MVP Volunteer Moderator

2023-11-16T07:13:41.7866667+00:00

Just checking if you had a chance to look at this. If so, can you please update?
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
Cody Dance 0 Reputation points

2023-11-16T19:23:11.75+00:00

@Vinodh247 Hi Vinhodh. Yes, I have looked at everything but the question has still not been answered.
phemanth 15,755 Reputation points Microsoft External Staff Moderator

2023-11-21T06:28:49.1933333+00:00

@Cody Dance

However, you can estimate the cost of the serverless SQL pool based on the amount of data processed by your dedicated SQL pool. One way to do this is to use the Query Store feature in Azure Synapse Analytics to capture the amount of data processed by each query in your dedicated SQL pool. You can then use this data to estimate the amount of data that will be processed in the serverless SQL pool and calculate the cost based on the pricing model.

Another way to estimate the cost of the serverless SQL pool is to use the Azure Synapse Analytics pricing calculator. The pricing calculator allows you to estimate the cost of the serverless SQL pool based on the amount of data processed, the number of queries, and other factors. You can use this tool to get an estimate of the cost of the serverless SQL pool based on your current workload.

I hope these steps help you resolve the issue. If you have any further questions or concerns, please let us know.
phemanth 15,755 Reputation points Microsoft External Staff Moderator

2023-11-22T11:45:57.84+00:00

@Cody Dance

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Answer 1

Vinodh247 34,661 MVP Volunteer Moderator

Hi Cody Dance

Thanks for reaching out to Microsoft Q&A.

The dedicated sql pool works like a typical DW database but measured in DWU (data warehouse units). The DWU cannot be measured like that of serverless sql pool because it is layered to few levels. The DWU is a combination of CPU, memory & IO only and storage transactions are not billed but only for stored data. If you have an idea on how much DWUs your dedicated pool is using you can roughly calculate an estimate using the below link. Only approx. estimate if you don’t know what the DWU is your workload is using, if you want to find that out you can do using this.

https://azure.microsoft.com/en-us/pricing/calculator/?service=synapse-analytics

Please 'Upvote'(Thumbs-up) and 'Accept' as answer if the reply was helpful. This will be benefitting other community members who face the same issue.

Cody Dance 0 Reputation points

2023-11-14T14:40:52.4266667+00:00

Hi @Vinodh247 . I know what my DWU workload is, but I don't see any way of converting that to a cost estimate for the serverless SQL pool. Am I missing something? I was hoping to be able to look at something like tempdb usage for the dedicated SQL pool to get an estimate for the serverless.
Vinodh247 34,661 Reputation points MVP Volunteer Moderator

2023-11-15T05:40:06.4833333+00:00

Cody Dance: Good point! But you cannot calculate the cost using the tempdb size or usage form the 'Cost Calculator' link I have provided you. If not wrong, i believe there is no provision available currently that would give us the estimated cost only using your tempdb usage.

I am also not sure if the azure support team can help if you raise a support ticket with a valid support plan.

Share via

How to measure data processed with dedicated sql pool?

1 answer

Your answer