How to install GraphViz on Azure Synapse Analytics to use in python notebooks

Question

How to install GraphViz on Azure Synapse Analytics to use in python notebooks

Abdelrahman (Abdo) Mohamed 10 Microsoft Employee

Hey! I am trying to install GraphViz so that I can start plotting some graphs in a python notebook in our Azure Synapse Analytics space. I managed to install the pypi package but I also need to install the system executable. What would be the best way to do so ? I have tried running User's image

but I needed sudo access so I have tried User's image

but it doesn't seem that this supported either. Can you point me in the right direction on how to install the executable so I can use graphviz ? A lot of libraries rely on it as a backend so it's currently blocking multiple scenarios for our team. Thanks in advance for your help!

Vinodh247 40,036 Reputation points MVP Volunteer Moderator

2023-04-16T06:21:04.4566667+00:00

Hi Thanks for reaching out to Microsoft Q&A. Try with .whl files packages from synapse studio. Synapse studio--> manage --> spark pools-->click on 3 dots-->packages I followed the below URL and it worked. https://dustinvannoy.com/2022/01/20/azure-synapse-spark-external-python-packages/ Please Upvote and Accept as answer if the reply was helpful, this will be helpful to other community members.
Abdelrahman (Abdo) Mohamed 10 Reputation points Microsoft Employee

2023-04-17T16:13:24.8+00:00

Thanks for taking the time to respond! Unfortunately, this is not a python package issue but rather an OS package so the guide provided would not work.

1 answer

Your answer

Vinodh247 40,036 Reputation points MVP Volunteer Moderator

2023-04-16T06:21:04.4566667+00:00

Hi Thanks for reaching out to Microsoft Q&A. Try with .whl files packages from synapse studio. Synapse studio--> manage --> spark pools-->click on 3 dots-->packages I followed the below URL and it worked. https://dustinvannoy.com/2022/01/20/azure-synapse-spark-external-python-packages/ Please Upvote and Accept as answer if the reply was helpful, this will be helpful to other community members.
Abdelrahman (Abdo) Mohamed 10 Reputation points Microsoft Employee

2023-04-17T16:13:24.8+00:00

Thanks for taking the time to respond! Unfortunately, this is not a python package issue but rather an OS package so the guide provided would not work.

Answer 1

PRADEEPCHEEKATLA 91,496 Moderator

Abdelrahman (Abdo) Mohamed - Thanks for the question and using MS Q&A platform.

You can use pip and %pip commands to manage libraries in the Notebook code cells.

User's image

For more details, refer to Manage libraries for Apache Spark in Azure Synapse Analytics.
Hope this helps. Do let us know if you any further queries.

Abdelrahman (Abdo) Mohamed 10 Reputation points Microsoft Employee

2023-04-17T16:10:05.79+00:00

Hey! Thanks for taking the time to answer! Unfortunately, installing graphviz requires both a python package as well as an executable to be installed. https://graphviz.org/download/ For example, if you follow literally the next step in the Getting started guide, it fails
PRADEEPCHEEKATLA 91,496 Reputation points Moderator

2023-04-18T06:03:39.7166667+00:00

Abdelrahman (Abdo) Mohamed - As per the test, it has been working as expected.

Tried to repro, the steps metioned in the document: https://graphviz.readthedocs.io/en/stable/

Note: I had tried all the possible ways of installation python packages available in synapse but none of the method works for dot.

When I tried to run dot, I'm getting this error message: ExecutableNotFound: failed to execute PosixPath('dot'), make sure the Graphviz executables are on your systems' PATH.

For a deeper investigation and immediate assistance on this issue, if you have a support plan you may file a support ticket.
Abdelrahman (Abdo) Mohamed 10 Reputation points Microsoft Employee

2023-04-18T16:55:45.5433333+00:00

Thanks a ton again! Yes, to be able to fully use GraphViz and render the actual graphs, we need to install both the python package as well as the system executable (the error trace is simply a call to the OS to run the system executable). The issue is a lot of python packages like lightgbm uses GraphViz as their graph backend, so when you call something like this plot_tree function, it fails on the same error bc the system executable is not there. https://lightgbm.readthedocs.io/en/latest/pythonapi/lightgbm.plot_tree.html Anyways, thanks for the help! I will move with filing a ticket since I need to unblock this scenarios.
PRADEEPCHEEKATLA 91,496 Reputation points Moderator

2023-04-19T08:22:38.7+00:00

Abdelrahman (Abdo) Mohamed - Once you raise a support ticket, please do share SR number with us to track internally.
PRADEEPCHEEKATLA 91,496 Reputation points Moderator

2023-04-24T05:47:30.79+00:00

Abdelrahman (Abdo) Mohamed - Did you get a chance to open a support ticket?

Share via

How to install GraphViz on Azure Synapse Analytics to use in python notebooks

1 answer

Your answer