How to see Azure Costs by Pipeline

Jay 536 Reputation points
2021-09-27T07:28:39.267+00:00

H,

I have a pipeline in Azure which every 5mins checks an external ftp server to see if a file is available, if file exists it moves the file to an on-prem drive.

I just looked at Data Factory Cost and when this job went live the ADF cost has jump from a few pounds to £130 a month so this simple ftp moving job could be costing £1,500 a year.

Have I missed something here, why is it so expensive?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,544 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Saurabh Sharma 23,676 Reputation points Microsoft Employee
    2021-09-27T19:07:50.937+00:00

    Hi @Jay ,

    Thanks for using Microsoft Q&A !!
    Azure Data pricing pipeline is based on the following factors -

    • Pipeline Orchestration/Execution
    • Data flow execution if any
    • Number Data factory operations
      You need to check the Pipeline run consumption details like Activity Runs, Activity Execution hours etc. on "Pipeline Runs" page on ADF Monitor against the above mentioned pipeline-
      135629-image.png
      And then you can fed Azure Pricing Calculator with the required details to get an estimated cost of the pipeline runs to understand if it resembles your actual billing. In case you see any discrepancies or want to know more about billing, then you probably need to check open an Azure Support ticket so that an engineer could look into your environment.

    For ADF Pricing details please refer to Data Pipeline pricing

    Thanks
    Saurabh