execution plan in databricks

Question

execution plan in databricks

Vineet S 1,390

How to check execution plan in data bricks

select * from cte

2 answers

Your answer

Answer 1

Amira Bedhiafi 33,071 Volunteer Moderator

You have 3 alternatives and feel free to use the one that you are comfortable with :

Follow the documentation to see an example for each use :

https://learn.microsoft.com/en-us/azure/databricks/optimizations/aqe#query-plans

Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator

2024-04-17T18:46:50.64+00:00

Thank you Amira Bedhiafi

Hello Vineet,

If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions
Vineet S 1,390 Reputation points

2024-04-18T00:10:12.2833333+00:00

Let's say we have query Select col1 fom table1 join table2 on col1=col1 order by then which query will run first
Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator

2024-04-19T23:10:18.5666667+00:00

for you above quesiton, first tables are joined, then the columns specified in the SELECT clause are selected.

finally results are sorted based on "order by"
Vineet S 1,390 Reputation points

2024-04-23T10:46:40.8166667+00:00

i did not understand how it works first it will take order by or group by or aggregation query.. I know sql server plan
Vineet S 1,390 Reputation points

2024-04-24T14:19:23.6566667+00:00

suggestion pls
Amira Bedhiafi 33,071 Reputation points Volunteer Moderator

2024-04-25T20:17:35.6966667+00:00

What do you want to understand exactly ?
Vineet S 1,390 Reputation points

2024-04-25T22:55:14.4933333+00:00

Which order it runs first aggregation, order by, group but or select columns
Amira Bedhiafi 33,071 Reputation points Volunteer Moderator

2024-04-26T07:13:15.42+00:00
In Databricks, or any SQL-based data processing system, the order of operations when executing a SQL query generally follows this sequence :

FROM

ON

JOIN

WHERE

GROUP BY

WITH CUBE/ROLLUP

HAVING

SELECT

DISTINCT

ORDER BY

TOP

OFFSET/FETCH

Can you please close the question and open a new one if you have other things to ask about?
Vineet S 1,390 Reputation points

2024-04-26T07:21:55.2+00:00

No. It is starting with order by or group clause... Can you check once... Happy to close after purpose is resolved
Amira Bedhiafi 33,071 Reputation points Volunteer Moderator

2024-04-26T07:28:08.48+00:00

What is your source? But your purpose in the question is about checking the execution plan in the query you provided and not the logical query processing in Databricks.
Vineet S 1,390 Reputation points

2024-04-26T08:10:07.56+00:00

Source is CSV and it is Delta table
Amira Bedhiafi 33,071 Reputation points Volunteer Moderator

2024-04-29T12:53:40.1033333+00:00

Can you gather everything in one question ?

I can say that we provided you with the answer for your initial question.
Vineet S 1,390 Reputation points

2024-04-29T13:00:38.9666667+00:00

that's all i said is above
Amira Bedhiafi 33,071 Reputation points Volunteer Moderator

2024-04-29T13:02:36.4433333+00:00

Do you consider this as a complete question with all details ?

Answer 2

Hi Vineet,

Here is a good explanation of using the explain function in databricks:

https://www.advancinganalytics.co.uk/blog/2021/10/11/databricks-execution-plans

More information on the EXPLAIN function:

https://docs.databricks.com/en/sql/language-manual/sql-ref-syntax-qry-explain.html

When you ask Databricks to explain your query, it gives you a detailed explanation of how it's going to carry out your request. This helps you understand how fast or slow your query might be and if there are any places where it might get stuck.

If this is helpful please accept answer.

Share via

execution plan in databricks

2 answers

Your answer