how do I schedule a data factory run

Green Jr, Charles M 20 Reputation points
2024-08-16T16:26:56.81+00:00

HOw do I schedule a data factory trigger to run the factory weekly

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,350 questions
{count} votes

Accepted answer
  1. Amira Bedhiafi 29,946 Reputation points
    2024-08-17T17:39:19.09+00:00

    You can use a time-based trigger :

    https://learn.microsoft.com/en-us/azure/data-factory/how-to-create-schedule-trigger?tabs=data-factory

    https://learn.microsoft.com/en-us/azure/data-factory/concepts-pipeline-execution-triggers

    Step 1: Create a New Trigger

    1. Open Azure Data Factory: Go to the Azure portal and navigate to your Data Factory instance.
    2. Author & Monitor: Click on the "Author & Monitor" tile to open the Data Factory UI.
    3. Create a New Trigger:
      • In the left-hand pane, go to the Manage section (the wrench icon).
      • Under Triggers, click the New button.

    Step 2: Configure the Trigger

    1. Basic Settings:
      • Name: Give your trigger a descriptive name, such as WeeklyTrigger.
      • Type: Set the trigger type to Schedule.
    2. Schedule Settings:
      • Start Date: Set the start date and time when you want the first run to occur.
      • Recurrence: Set the recurrence to Week and choose the interval (e.g., every 1 week).
      • Days of the Week: Select the day of the week you want the pipeline to run.
      • End Date: Optionally, set an end date if you want the trigger to stop after a certain period.

    Step 3: Associate the Trigger with a Pipeline

    1. Select Pipeline: Go to the Author tab (pen icon) in the left-hand pane and select the pipeline you want to run on a schedule.
    2. Add Trigger:
      • At the top of the pipeline canvas, click on Add Trigger and select New/Edit.
      • Choose the trigger you created (WeeklyTrigger).
      • Configure any additional parameters if your pipeline requires them.
      • Click OK to save the trigger to your pipeline.

    Step 4: Publish All

    After creating and configuring the trigger, don't forget to click Publish All to deploy your changes.

    Step 5: Monitor the Trigger

    You can monitor the execution of your pipeline by navigating to the Monitor section in the Data Factory UI. Here you can see when the trigger executes, the success/failure of the pipeline runs, and more.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.