Install Libraries in Job cluster

Rohit Kulkarni 691 Reputation points
2022-11-18T15:12:26.507+00:00

How to install the libraries in the job cluster.Please refer the Job screenshot from the databricks:

261964-image.png

Regards
RK

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,258 questions
0 comments No comments
{count} votes

Accepted answer
  1. PRADEEPCHEEKATLA 90,246 Reputation points
    2022-11-21T07:30:14.477+00:00

    Hello @Rohit Kulkarni ,

    Thanks for the question and using MS Q&A paltform.

    You can install the libraries using the below methods:

    First: using Dependent libraries:

    Dependent libraries will be installed on the cluster before the task runs. You must set all task dependencies to ensure they are installed before the run starts.

    To add a dependent library, click Advanced options and select Add Dependent Libraries to open the Add Dependent Library chooser. Follow the recommendations in Library dependencies for specifying dependencies.

    262521-image.png

    Second: Using the existing cluster which has libraries installed on it.

    262495-image.png

    For more details, refer to Create, run, and manage Azure Databricks Jobs and How to install a library on a databricks cluster using some command in the notebook?.

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is jhow you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.