Can you run AZURE Databricks pipeline in Azure without ADF ?

Mudassar A 491 Reputation points
2021-08-06T15:52:38.75+00:00

Can you run AZURE Databricks pipeline in Azure without ADF ?

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,212 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,811 questions
{count} votes

Accepted answer
  1. Vaibhav Chaudhari 38,746 Reputation points
    2021-08-09T15:26:31.743+00:00

    You can create a Databricks job and add a notebook to run from there or open the Notebook and right top corner, select Schedule notebook option

    https://learn.microsoft.com/en-us/azure/databricks/jobs
    https://learn.microsoft.com/en-us/azure/databricks/notebooks/notebooks-manage#schedule-a-notebook

    ----------

    Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav

    1 person found this answer helpful.
    0 comments No comments

1 additional answer

Sort by: Most helpful
  1. Nandan Hegde 32,416 Reputation points MVP
    2021-08-09T03:20:39.493+00:00

    Hey,
    Yes, you can create jobs and schedule databricks notebook :
    https://learn.microsoft.com/en-us/azure/databricks/jobs

    1 person found this answer helpful.
    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.