Is the Azure notebookutils python package available to on a local development system?

Question

We are developing a python application to run in Azure Synapse. We want to use mssparkutils, which is part of the notebooktuils package. It doesn't appear that notebookutils is available in the pypi index to be downloaded locally. Is it available somewhere else or maybe under a different name?

Answer 1

Hello @Jarrett Anderson ,
Thanks for the question and using MS Q&A platform.

As I understand, you inquiry is whether you can use the mssparkutils/notebookutils in local development.

Please let me give you a more comprehensive understanding.

Notebookutils is specific to the Notebooks in Azure Synapse. It adds functionality which is not applicable to a pure python environment on your local machine. The notebook runs on pySpark. PySpark runtime is different from normal Python interpreter runtime.

So, no you cannot get these libraries from pyPi. Even if you could it might not work on regular Python.

What you can do, is stub out placeholders. Or maybe use the VSCode option, however there may be an issue in it.

Please do let me if you have any queries.

Thanks
Martin

---

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators