Azure Data Factory Maximum allotments and metric alerts questions

Murray, Blake 1 Reputation point
2022-03-09T20:33:41.437+00:00

We are implementing metric alerts for an Azure Data Factory. There are signals where I am confused on some or how to set the alert logic for one.

  • Total factory size (GB unit) - could you do a metric alert on this? What would the logic be?
  • Maximum allowed factory size (GB unit) - is there a maximum factory size in GB? I know there are limits on total number of resources, but I haven't found anything in docs showing this.
  • Maximum allowed entities count - I know the total is 5000, but is there somewhere you can set a different max?
    • Elapsed Time Pipeline Runs Metrics - what would the alert logic be for any pipeline that has run over 4 hours?
Azure Monitor
Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
2,812 questions
Azure AI Metrics Advisor
Azure AI Metrics Advisor
An Azure artificial intelligence analytics service that proactively monitors metrics and diagnoses issues.
80 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,600 questions
0 comments No comments
{count} votes

3 answers

Sort by: Most helpful
  1. HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
    2022-03-10T21:57:43.607+00:00

    Hello @Murray, Blake ,
    Thanks for the question and using MS Q&A platform.
    As we understand the ask here is how we can use the metrics please do let us know if its not accurate.
    When looking at the first three metrics , i do not thing that you can configure them to a custom value . I am checking back on these with the product team and will update you on the same .

    181995-image.png

    For the last ask , at this time the window bucket is done at 6,12,24.... hrs and configuring somethng for 4 hrs cannot be done from the UI . Please go ahead add a feedback here https://feedback.azure.com/d365community/forum/1219ec2d-6c26-ec11-b6e6-000d3a4f032c

    Please do let me if you have any queries.
    Thanks
    Himanshu


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments

  2. Murray, Blake 1 Reputation point
    2022-03-11T15:35:53.22+00:00

    Yes those are what I am referring to.

    The first 3 I am just wanting to if those are even possible to check/know? If you can't set maximum values for ADF or it's entities I don't know what that metric is used for then.

    I think my best option for the last one is to use log analytics and write a custom alert from there then.


  3. John_Ting-丁裕紘 1 Reputation point
    2022-07-13T00:40:41.863+00:00

    Total factory size - Because azure data factory's log which include linked servce, dataset, pipeline ...... are stored in the form of json text, the size here refers to the size of the data stored

    0 comments No comments