Is Data factory really needs cluster configuration for running? Can we run datafactory without any cluster configuration ?

Thiyagarajan S 41 Reputation points
2022-01-21T05:13:24.63+00:00

Hi team,
I am doing PAAS based project using data factory. We need push values from excel to mysql. For this do we really need cluster configuration or it will run with in azure without any cost apart from Data factory execution cost.

Help and suggestion much appreciated..

Thanks & Regards,
Thiyagarajan.S

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,624 questions
0 comments No comments
{count} votes

Accepted answer
  1. Vaibhav Chaudhari 38,916 Reputation points Volunteer Moderator
    2022-01-21T06:54:16.527+00:00

    For your scenario where data has to be copied from one source to another, you can simply create a pipeline and use a Copy activity.

    • Copy Activity runs on Azure IR. It won't need any cluster
    • Cost depends on execution time of Copy activity and number of DIU units configured in activity. Search "ADF Pricing" for more details.
    • Spark clusters are required when you use the data flow inside ADF

    Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav


0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.