Azure Data Factory CPU usage in dataflows

Alberto Font Escribano 21 Reputation points
2022-04-04T14:44:43.87+00:00

Hi all,

We have a dataflow in Azure Data Factory that is transforming data from a table in a database. We create several activities like Derived Columns, Joins, Filters.. which all use this table as the source.

The question is if the CPU from that database is being used when we run this dataflow in the pipeline or if only the CPU from ADF is being used.

Any help on this is much appreciated.

Alberto

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
7,160 questions
0 comments
Accepted answer
  1. MarkKromer-MSFT 5,156 Reputation points Microsoft Employee
    2022-04-05T03:40:59.717+00:00

    The only time your database table will be queried is when the data is acquired from the source transformation. After that, all of the computation is taking place on the ADF managed Spark environment.

    1 person found this answer helpful.
    0 comments

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest