Missing PIL from AzureML TF 2.3 curated environment

Tibor Sloboda 1

I've been attempting to run my machine learning experiments (computer vision) on the curated environment AzureML provides, that has TensorFlow 2.3 (whose dependency should be PIL), but I keep getting an error stating that PIL is not present. Specifically, it crashed at it saying that PIL.Image cannot be imported.

I have run my script on my local computer without issue using the same dependencies (as saved from the curated environment). The error only seems to happen on the remote during a run.

romungi-MSFT 44,586 Reputation points Microsoft Employee

2021-02-16T12:00:12.917+00:00
@Tibor Sloboda Looked up the packages installed for AzureML TF2.3 curated environment and it looks like pillow is not installed.

Name AzureML-TensorFlow-2.3-GPU packages channels: - conda-forge dependencies: - python=3.6.2 - pip: - azureml-core==1.18.0.post1 - azureml-defaults==1.18.0 - azureml-telemetry==1.18.0 - azureml-train-restclients-hyperdrive==1.18.0 - azureml-train-core==1.18.0 - tensorflow-gpu==2.3.0 - cmake==3.18.2 - horovod==0.20.0 name: azureml_60ad88840fdbe40e31e03ddbbc134dec

You can add a requirements file and install the package in the environment on the remote machine. Just curious if you could list the packages on your local environment for the same image and check if the missing package might have been installed?
Tibor Sloboda 1 Reputation point

2021-02-16T14:27:38.417+00:00

That's truly weird. I have my environment set up as a virtual environment locally, with a fresh install of TF. It is possible
pillow got installed alongside opencv, since I also had that installed.

I've tried installing the packages on the environment on the remote machine before but I failed several times, each for different reasons.
Would you mind explaining how I can set up a tensorflow gpu environment with the dependencies?..

I've managed to already get the dependencies alone installed on the remote machine, but there was an issue with the GPU being
unable to get initialized due to some missing libraries, and I got stuck there.

Also -- would it be possible, as a feedback to Microsoft, to recommend adding Pillow to the curated environment? :] .. Pillow is needed for some
functionality within native TensorFlow, so it would only make sense to include it

Share via

Missing PIL from AzureML TF 2.3 curated environment

Your answer