Azure Data Factory Trigger will not fire

Andrew Hopkinson 6 Reputation points
2024-04-11T00:18:30.07+00:00

I created a scheduled trigger for a pipeline in ADF, the pipeline is setup in Git and Devops to automatically deploy to the server on any change. It deploys successfully and the trigger is there, however when I go to "monitor" the scheduled trigger runs are empty. I have tried every increment, 15 minutes, hourly every 1 minute and nothing works. There no errors. I make sure the start date and time is back dated one day. What am I missing?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,426 questions
{count} votes

3 answers

Sort by: Most helpful
  1. Andrew Hopkinson 6 Reputation points
    2024-04-11T16:55:20.3133333+00:00
    1. Manual Trigger: Test the pipeline's functionality by manually triggering it.
      1. It works
    2. Trigger History: Examine the trigger's run history in detail for potential clues.
      1. Run history is fine, not scheduled trigger run history
    3. Pipeline Logging: Enhance logging configuration within the pipeline to capture execution details for analysis.
      1. Does not exectue from scheduled trigger so no logging.
    4. Trigger Logs: Analyze trigger-specific logs using Azure Monitor for insights.
      1. Does not execute from scheduled trigger so no logging
    5. DevOps Integration: Review DevOps release pipelines for errors in triggering or deployment steps.
      1. Devops release pipeline works
    6. Deployment Delays: Account for potential delays in pipeline activation after deployment.
      1. Waited a full day, did not execute
    7. Concurrent Runs: Check for restrictions on concurrent pipeline executions.
      1. No restrictions
    8. Gateway Configuration: Verify correct configuration of any self-hosted integration runtimes involved.
      1. Not using self hosted runtime, all done in ADF
    9. Permissions: Ensure that the ADF service principal has necessary permissions for trigger execution.
      1. What are the required permissions? How would I see the error? I just see nothing
    10. Caching Issues: Clear your browser's cache or try accessing from a different browser/incognito mode.
      1. Tried in Edge instead of Chrome, same problem
    11. Trigger Dependencies: Confirm that any external dependencies for the trigger are met.
      1. No trigger dependencies
    12. Azure Service Health: Check for known service issues affecting ADF.
      1. Azure health is ok
    0 comments No comments

  2. Andrew Hopkinson 6 Reputation points
    2024-04-11T17:40:45.79+00:00

    I think actually the problem is that Devops pipeline is saying that is completing but the trigger is not being published.


  3. phemanth 15,160 Reputation points Microsoft External Staff
    2024-04-12T03:07:54.8366667+00:00

    @Andrew Hopkinson

    Welcome to Microsoft Q&A platform and thanks for posting your question.

    I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others "I'll repost your solution in case you'd like to accept the answer.

    Ask: I created a scheduled trigger for a pipeline in ADF, the pipeline is setup in Git and Devops to automatically deploy to the server on any change. It deploys successfully and the trigger is there, however when I go to "monitor" the scheduled trigger runs are empty. I have tried every increment, 15 minutes, hourly every 1 minute and nothing works. There no errors. I make sure the start date and time is back dated one day. What am I missing?

    **Solution:**Ok, I found the problem, you should add this to your trouble shooting, make sure that you have this line added to your Devops pipeline deployment:

    TriggerPath: '$(Build.Repository.LocalPath)/trigger'
    
    

    In addition, it seems to default to status of "stopped", so you will need to add a start task:

    - task: toggle-adf-trigger@2
      inputs:
        azureSubscription: 'xxxxx'
        ResourceGroupName: 'CNX-Core-DEV'
        DatafactoryName: 'CNX-DF-DEV'
        TriggerFilter: 'Hour Trigger Env'
        TriggerStatus: 'start'
    

    If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.

    If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.


    Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.