Azure data bricks Clusters

Question

Azure data bricks Clusters

Rohit Kulkarni 731

Hello Team,

I have one scenario, When the cluster in azure data bricks starts on demand then the specific workflow needs to start automatically it possible if yes then how it can be done.

Regards
Rohit

PRADEEPCHEEKATLA 91,846 Reputation points

2022-12-08T11:07:08.867+00:00

Hello @Rohit Kulkarni ,

Thanks for the question and using MS Q&A platform.

We are reaching out to internal team to get more information related to your query and will get back to you as soon as we have an update.
PRADEEPCHEEKATLA 91,846 Reputation points

2022-12-16T09:18:06.66+00:00

Hello @Rohit Kulkarni ,

I'm a little confused about the scenario you are describing. Is it your intention to manually start an interactive Databricks cluster, have a Spark job that is automatically run as soon as the cluster starts, and then the cluster remains on so that additional analysis can be performed on the datasets that get loaded into memory?
PRADEEPCHEEKATLA 91,846 Reputation points

2022-12-22T03:56:24.16+00:00

Hello @Rohit Kulkarni ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond with more details and we will try to help.