Unable to install Python packages Azure Synapse Spark Pool

Question

Unable to install Python packages Azure Synapse Spark Pool

Dhruv Khanna 1

Trying to install Python library great expectations, for which I downloaded the latest available .whl file. I followed the steps described in MS documentation to install the package to my Spark Pool, and repeatedly got the following error -

ERROR b'Warning: This Script only works on conda release 4.9.2 Other release is not guaranteed!\n/usr/lib/library-manager/bin\npatching file /usr/lib/miniforge3/lib/python3.8/site-packages/conda/misc.py\nReversed (or previously applied) patch detected! Assume -R? [n] \nApply anyway? [n] \nSkipping patch.\n1 out of 1 hunk ignored -- saving rejects to file /usr/lib/miniforge3/lib/python3.8/site-packages/conda/misc.py.rej\n'","22/08/29 18:12:41 INFO Cleanup following folders and files from staging directory:","22/08/29 18:12:41 INFO Staging directory cleaned up successfully"],"registeredSources":null}

Not sure what the error related to conda 4.9.2 means, and how I can address it.

PRADEEPCHEEKATLA 91,866 Reputation points

2022-08-30T07:45:08.51+00:00
Hello @Dhruv Khanna ,

Thanks for the question and using MS Q&A platform.

Could you please help us to with the python package which you are trying to install?

Is it possible to retrieve the stderr logs for me so I can escalate this to our backend team? Please let me know if there are any questions.

To view these logs:

Navigate to the Spark applications list in the Monitor tab.

Select the system Spark application job that corresponds to your pool update. These system jobs run under the SystemReservedJob-LibraryManagement title.

Switch to view the driver and stdout logs.

Within the results, you'll see the logs related to the installation of your packages.
PRADEEPCHEEKATLA 91,866 Reputation points

2022-09-08T08:30:03.347+00:00

Hello @Dhruv Khanna ,

Just checking in if you have had a chance to see the previous response. We need the following information to understand/investigate this issue further.