Trigger types for Databricks Jobs
You can configure job runs to trigger on a time-based schedule, file arrival triggers, or to run continuously.
You can also manually trigger job runs or use external orchestration tools to trigger a job run.
Job schedules & triggers
Trigger type | Behavior |
---|---|
Scheduled | Triggers a job run based on a time-based schedule. See Run jobs on a schedule. |
File arrival | Triggers a job run when new files arrive in a monitored Unity Catalog storage location. See Trigger jobs when new files arrive. |
Continuous | To keep the job always running, trigger another job run whenever a job run completes or fails. See Run jobs continuously. |
None (manual) | Runs are triggered manually with the Run now button or programmatically using other orchestration tools. See Trigger a single job run |
You can only have one trigger defined for a job, but you can always use Run now to manually trigger a run. See Trigger a single job run.
Manually triggering a job run does not resume the job schedule. See Pause and resume job triggers.
By default, only a single run of a job can be active at a time. Triggered runs are skipped when they exceed the configured max concurrency for a job. See Configure maximum concurrent runs.
Note
If one or more tasks in a job with multiple tasks are unsuccessful, you can re-run the subset of unsuccessful tasks. See Re-run failed and skipped tasks.
Pause and resume job triggers
When you pause a trigger, any currently active runs continue, but the trigger no longer starts new runs.
When you resume a trigger, the configured behavior resumes on the same schedule previously configured.
Note
If any run is active when a continuous trigger is resumed, the job scheduler waits until that run is complete to trigger a new run.
Buttons to pause and resume your job are dynamically displayed in the Job details panel for your job under Schedules & Triggers. These buttons only appear for jobs that have a trigger defined.
- If the trigger is active, click Pause.
- If the trigger is paused, click Resume
When creating or editing a trigger, you can also control these settings in the Schedules & Triggers dialog. Toggle between the Active and Paused to control the Trigger Status.