Data Factory Trigger not running

Anonymous
2020-11-10T20:47:14.757+00:00

I had a similar issue last week, then the Data Factory triggers mysteriously started working again.

Last night at 6pm I set up a data factory trigger to start at 7:45pm (New Zealand Time). The Trigger and Pipeline were published before 6pm and I assumed it would work. Checking the monitoring the next morning, the trigger never started.

38931-adferror5.png

38941-adferror6.png

We are getting tired of Data Factory triggers not working correctly, last time I raised this the MSFT person tried it in our region (we are in New Zealand, using NZ time, however using an Australia East data centre). It worked for the MSFT person, then it began working for us. It seems like there is an outage or some bugs with the Trigger operations.

This is beginning to impact our timelines now, we may move away from Data Factory due to lack of reliability. Anything I am doing wrong here? It seems like the recent Timezone update may have not worked properly for our region or there are some bugs with it.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,843 questions
{count} votes

Accepted answer
  1. HarithaMaddi-MSFT 10,136 Reputation points
    2020-11-12T07:46:17.37+00:00

    Hi @Anonymous ,

    Thanks for sharing the details. I looked at it closely and was able to reproduce it when trigger start time is same as "scheduled time" highlighted in below snap. Please ensure that start date is at least 1minute less than the schedule time and it is triggered properly in that case for me. As confirmed from you, I have added details to document accordingly in the PR and changes will reflect by today EOD or tomorrow.

    I understand that feature to consider schedule execution time when same as start date is more appropriate, I would recommend you to post an idea in feedback forum which will be closely monitored by Azure Data Factory Product team and will be considered for future releases.

    39250-image.png

    ---------------------

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.
    2 people found this answer helpful.

4 additional answers

Sort by: Most helpful
  1. Carlos Parra 56 Reputation points
    2021-05-17T13:52:09.153+00:00

    Yep, same issue here. Please fix to be "Trigger Start time must be greater than or equal to Start Date"

    1 person found this answer helpful.
    0 comments No comments

  2. Paul Finol 171 Reputation points
    2021-04-08T18:08:02.2+00:00

    had the same problem, thanks

    0 comments No comments

  3. Elaine Jacobson 21 Reputation points
    2021-07-01T17:44:09+00:00

    One further question on this issue: Is it really necessary to set up the "Execute at these times", if the time associated with the Start date is acceptable? The "Schedule execution times" reflects the time of "00:59" which aligns with the Start date? Please see the attached image to see what I have set up that isn't working. It should have triggered 111007-monthlytriggerexample.pngthis morning at 00:59 MDT, but it didn't.

    Thanks in advance for your help with this.

    0 comments No comments

  4. ThierryL 146 Reputation points
    2022-04-10T23:26:36.95+00:00

    I faced a similar problem today, but I haven't found the reason yet.
    Last Friday I set up a trigger to be executed every two weeks on Monday at 5AM local time (expecting that the trigger would be first executed the next Monday, and then two weeks later).
    It is now Monday 8AM and the trigger has not been executed.
    Here is the code associated with my trigger.

    {
      "etag": "[redacted]",
      "id": "/subscriptions/[redacted]/resourceGroups/handa_common/providers/Microsoft.DataFactory/factories/HandaDataFactory/triggers/Trigger_PRC_Training",
      "name": "Trigger_PRC_Training",
      "properties": {
        "additionalProperties": null,
        "annotations": [],
        "description": null,
        "pipelines": [
          {
            "parameters": {
              "date_time": "@{formatDateTime(trigger().startTime,'yyyyMMdd')}"
            },
            "pipelineReference": {
              "name": null,
              "referenceName": "PCRTrainingPipeline"
            }
          }
        ],
        "recurrence": {
          "additionalProperties": null,
          "endTime": null,
          "frequency": "Week",
          "interval": 2,
          "schedule": {
            "additionalProperties": null,
            "hours": [
              5
            ],
            "minutes": [
              0
            ],
            "monthDays": null,
            "monthlyOccurrences": null,
            "weekDays": [
              "Monday"
            ]
          },
          "startTime": "2022-04-08T06:51:00",
          "timeZone": "Korea Standard Time"
        },
        "runtimeState": "Started",
        "type": "ScheduleTrigger"
      },
      "resourceGroup": "handa_common",
      "type": "Microsoft.DataFactory/factories/triggers"
    }
    

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.