Share via

Price difference between running databricks notebook vs python file from ADF

STACHURA Daniel 26 Reputation points
2021-08-27T06:19:34.02+00:00

Question is only to understand price difference between those 2 activities so assumptions are:

  • Code executed in both activities is as similar as possible (doing exact same data transformation for example)
  • Both ADF pipelines have only one activity (1 with notebook activity and 1 with python activity)
  • Both activities are linked with exact same databricks cluster

In case described above, will there be price difference between executions?
From what I can see by looking on azure price calculator and on execution times of both pipelines I won`t suspect any difference but I heard few opinions that using Jar/Python activity is cheaper and would like to confirm it.

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,540 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,655 questions
0 comments
Accepted answer
  1. HimanshuSinha-msft 19,491 Reputation points Microsoft Employee Moderator
    2021-08-27T21:12:01.433+00:00

    Hello @STACHURA Daniel ,
    Thanks for the ask and using the Microsoft Q&A platform .
    I am with you on this , there should not be any difference in the price . This is called out here .

    "You pay for data pipeline orchestration by activity run and activity execution by integration runtime hours. "

    Since notebook and python are two different activities , they should have the same cost per execution .

    127256-image.png

    Thanks
    Himanshu
    Please do consider clicking on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members

    1 person found this answer helpful.
    0 comments

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.