Share via

Estimating Costs for Running Mapping Dataflow

Shafayat Syed 65 Reputation points
2024-11-28T14:37:08.04+00:00

Hi there,

I am trying to understand the specific variable cost component for running a set of mapping data flows within a parent Pipeline. I am doing a calculation and would like to understand if I am doing this correctly. We are on Pay as you go model.

This is the output from the parent pipeline which runs 12 child pipelines.

Is this understanding correct? Thanksimage

Each child pipeline has an output like thisUser's image

This is the pipeline compute setting for each child pipeline.

User's image

I am reading what it looks like there two factors to the cost of each child pipeline:

  1. of activities

  2. of vCore-hour

When estimating costs for each mapping dataflow, should I just go with

5 activity runs @ ($1.391 per 1000 runs) = $0.007
consumed vCore-hour of 0.6972 * $0.384 = $0.268

Total cost for Child pipeline: $0.2747

Imagine all 12 pipelines have identical consumption then it should be

12 child piplines@ $0.2747 = $3.296

12 activity runs @ ($1.391 per 1000 runs) = $0.016

Total cost for the Parent Pipeline = $3.312

Using this as a reference: https://azure.microsoft.com/en-ca/pricing/details/synapse-analytics/

User's image

User's image

Azure Synapse Analytics
Azure Synapse Analytics

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.


Answer accepted by question author

Anonymous
2024-11-29T14:27:09.6533333+00:00

@Shafayat Syed

Thanks for reaching out to Microsoft Q&A.

Your understanding of estimating the costs for running mapping data flows within a parent pipeline seems mostly correct.

Here’s a breakdown to ensure clarity:

Activity Runs Cost:

  • 5 activity runs @ $1.391 per 1000 runs = $0.007 per child pipeline.
  • For 12 child pipelines: 12 * $0.007 = $0.084.

vCore-Hour Cost:

  • Consumed vCore-hour of 0.6972 * $0.384 = $0.268 per child pipeline.
  • For 12 child pipelines: 12 * $0.268 = $3.216.

Total Cost for Each Child Pipeline:

  • $0.007 (activity runs) + $0.268 (vCore-hour) = $0.275 per child pipeline.

Total Cost for All 12 Child Pipelines:

  • 12 * $0.275 = $3.30.

Total Cost for the Parent Pipeline:

  • $3.30 (child pipelines) + $0.084 (activity runs) = $3.384.

So, the total estimated cost for the parent pipeline running 12 child pipelines would be $3.384.

Hope this helps. Do let us know if you any further queries.

Was this answer helpful?

1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.