How to fix environment image build status failed issue in azure machine learning

Question

While trying to create a custom environment in the GPU cluster in Azure machine learning using SDK I am getting the Environment image build status Failed.

This is my .yml file

name: custom-env
channels:
  - pytorch
  - defaults
  - conda-forge
dependencies:
  - anyio=3.5.0=py311haa95532_0
  - appdirs=1.4.4=pyhd3eb1b0_0
  - argon2-cffi=21.3.0=pyhd3eb1b0_0
  - argon2-cffi-bindings=21.2.0=py311h2bbff1b_0
  - attrs=22.1.0=py311haa95532_0
  - babel=2.11.0=py311haa95532_0
  - backcall=0.2.0=pyhd3eb1b0_0
  - beautifulsoup4=4.12.2=py311haa95532_0
  - blas=1.0=mkl
  - bleach=4.1.0=pyhd3eb1b0_0
  - bottleneck=1.3.5=py311h5bb9823_0
  - brotlipy=0.7.0=py311h2bbff1b_1002
  - bzip2=1.0.8=he774522_0
  - ca-certificates=2023.01.10=haa95532_0
  - certifi=2023.5.7=py311haa95532_0
  - cffi=1.15.1=py311h2bbff1b_3
  - charset-normalizer=2.0.4=pyhd3eb1b0_0
  - colorama=0.4.6=py311haa95532_0
  - comm=0.1.2=py311haa95532_0
  - cpuonly=2.0=0
  - debugpy=1.5.1=py311hd77b12b_0
  - decorator=5.1.1=pyhd3eb1b0_0
  - defusedxml=0.7.1=pyhd3eb1b0_0
  - entrypoints=0.4=py311haa95532_0
  - filelock=3.9.0=py311haa95532_0
  - freetype=2.12.1=ha860e81_0
  - giflib=5.2.1=h8cc25b3_3
  - icc_rt=2022.1.0=h6049295_2
  - idna=3.4=py311haa95532_0
  - intel-openmp=2023.1.0=h59b6b97_46319
  - ipykernel=6.19.2=py311h86cfffd_0
  - ipython_genutils=0.2.0=pyhd3eb1b0_1
  - jinja2=3.1.2=py311haa95532_0
  - joblib=1.1.1=py311haa95532_0
  - jpeg=9e=h2bbff1b_1
  - json5=0.9.6=pyhd3eb1b0_0
  - jsonschema=4.17.3=py311haa95532_0
  - jupyter_client=8.1.0=py311haa95532_0
  - jupyter_core=5.3.0=py311haa95532_0
  - jupyter_server=1.23.4=py311haa95532_0
  - jupyterlab=3.5.3=py311haa95532_0
  - jupyterlab_pygments=0.1.2=py_0
  - jupyterlab_server=2.22.0=py311haa95532_0
  - lerc=3.0=hd77b12b_0
  - libdeflate=1.17=h2bbff1b_0
  - libffi=3.4.4=hd77b12b_0
  - libiconv=1.16=h2bbff1b_2
  - libpng=1.6.39=h8cc25b3_0
  - libsodium=1.0.18=h62dcd97_0
  - libtiff=4.5.0=h6c2663c_2
  - libuv=1.44.2=h2bbff1b_0
  - libwebp=1.2.4=hbc33d0d_1
  - libwebp-base=1.2.4=h2bbff1b_1
  - libxml2=2.10.3=h0ad7f3c_0
  - libxslt=1.1.37=h2bbff1b_0
  - lxml=4.9.2=py311h2bbff1b_0
  - lz4-c=1.9.4=h2bbff1b_0
  - markupsafe=2.1.1=py311h2bbff1b_0
  - matplotlib-inline=0.1.6=py311haa95532_0
  - mistune=0.8.4=py311h2bbff1b_1000
  - mkl=2023.1.0=h8bd8f75_46356
  - mkl-service=2.4.0=py311h2bbff1b_1
  - mkl_fft=1.3.6=py311hf62ec03_1
  - mkl_random=1.2.2=py311hf62ec03_1
  - mpmath=1.2.1=py311haa95532_0
  - nbclassic=0.5.5=py311haa95532_0
  - nbclient=0.5.13=py311haa95532_0
  - nbconvert=6.5.4=py311haa95532_0
  - nbformat=5.7.0=py311haa95532_0
  - nest-asyncio=1.5.6=py311haa95532_0
  - networkx=2.8.4=py311haa95532_1
  - notebook=6.5.4=py311haa95532_0
  - notebook-shim=0.2.2=py311haa95532_0
  - numexpr=2.8.4=py311h1fcbade_1
  - numpy=1.24.3=py311hdab7c0b_1
  - numpy-base=1.24.3=py311hd01c5d8_1
  - openssl=1.1.1t=h2bbff1b_0
  - packaging=23.0=py311haa95532_0
  - pandas=1.5.3=py311heda8569_0
  - pandocfilters=1.5.0=pyhd3eb1b0_0
  - parso=0.8.3=pyhd3eb1b0_0
  - pickleshare=0.7.5=pyhd3eb1b0_1003
  - pillow=9.4.0=py311hd77b12b_0
  - pip=23.0.1=py311haa95532_0
  - platformdirs=2.5.2=py311haa95532_0
  - pooch=1.4.0=pyhd3eb1b0_0
  - prometheus_client=0.14.1=py311haa95532_0
  - psutil=5.9.0=py311h2bbff1b_0
  - pure_eval=0.2.2=pyhd3eb1b0_0
  - pycparser=2.21=pyhd3eb1b0_0
  - pygments=2.15.1=py311haa95532_1
  - pyrsistent=0.18.0=py311h2bbff1b_0
  - pysocks=1.7.1=py311haa95532_0
  - python=3.11.3=h966fe2a_0
  - python-dateutil=2.8.2=pyhd3eb1b0_0
  - python-fastjsonschema=2.16.2=py311haa95532_0
  - pytorch=2.0.1=py3.11_cpu_0
  - pytorch-mutex=1.0=cpu
  - pytz=2022.7=py311haa95532_0
  - pywin32=305=py311h2bbff1b_0
  - pywinpty=2.0.10=py311h5da7b33_0
  - pyzmq=25.0.2=py311hd77b12b_0
  - requests=2.29.0=py311haa95532_0
  - scikit-learn=1.2.2=py311hd77b12b_0
  - scipy=1.10.1=py311hc1ccb85_1
  - send2trash=1.8.0=pyhd3eb1b0_1
  - setuptools=66.0.0=py311haa95532_0
  - six=1.16.0=pyhd3eb1b0_1
  - sniffio=1.2.0=py311haa95532_1
  - soupsieve=2.4=py311haa95532_0
  - sqlite=3.41.2=h2bbff1b_0
  - stack_data=0.2.0=pyhd3eb1b0_0
  - sympy=1.11.1=py311haa95532_0
  - tbb=2021.8.0=h59b6b97_0
  - terminado=0.17.1=py311haa95532_0
  - threadpoolctl=2.2.0=pyh0d69192_0
  - tinycss2=1.2.1=py311haa95532_0
  - tk=8.6.12=h2bbff1b_0
  - tomli=2.0.1=py311haa95532_0
  - torchaudio=2.0.2=py311_cpu
  - torchvision=0.15.2=py311_cpu
  - tornado=6.2=py311h2bbff1b_0
  - typing-extensions=4.5.0=py311haa95532_0
  - typing_extensions=4.5.0=py311haa95532_0
  - tzdata=2023c=h04d1e81_0
  - urllib3=1.26.15=py311haa95532_0
  - vc=14.2=h21ff451_1
  - vs2015_runtime=14.27.29016=h5e58377_2
  - webencodings=0.5.1=py311haa95532_1
  - websocket-client=0.58.0=py311haa95532_4
  - wheel=0.38.4=py311haa95532_0
  - win_inet_pton=1.1.0=py311haa95532_0
  - winpty=0.4.3=4
  - xz=5.4.2=h8cc25b3_0
  - zeromq=4.3.4=hd77b12b_0
  - zlib=1.2.13=h8cc25b3_0
  - zstd=1.5.5=hd43e919_0
  - pip:
      - adal==1.2.7
      - applicationinsights==0.11.10
      - argcomplete==2.1.2
      - asttokens==2.2.1
      - azure-ai-ml==1.8.0
      - azure-common==1.1.28
      - azure-core==1.27.1
      - azure-graphrbac==0.61.1
      - azure-identity==1.13.0
      - azure-mgmt-authorization==3.0.0
      - azure-mgmt-containerregistry==10.1.0
      - azure-mgmt-core==1.4.0
      - azure-mgmt-keyvault==10.2.2
      - azure-mgmt-resource==22.0.0
      - azure-mgmt-storage==21.0.0
      - azure-storage-blob==12.16.0
      - azure-storage-file-datalake==12.11.0
      - azure-storage-file-share==12.12.0
      - azureml-core==1.51.0.post1
      - azureml-pipeline==1.0.23
      - azureml-pipeline-core==1.0.23
      - azureml-pipeline-steps==1.0.23
      - azureml-sdk==1.0.23
      - azureml-telemetry==1.0.23
      - azureml-train==1.0.23
      - azureml-train-core==1.0.23
      - azureml-train-restclients-hyperdrive==1.0.23
      - backports-tempfile==1.0
      - backports-weakref==1.0.post1
      - bcrypt==4.0.1
      - cachetools==5.3.1
      - contextlib2==21.6.0
      - contourpy==1.0.7
      - cryptography==41.0.1
      - cycler==0.11.0
      - docker==6.1.3
      - executing==1.2.0
      - fonttools==4.39.4
      - google-api-core==2.11.1
      - google-auth==2.20.0
      - googleapis-common-protos==1.59.1
      - humanfriendly==10.0
      - ipython==8.13.2
      - isodate==0.6.1
      - jedi==0.18.2
      - jeepney==0.8.0
      - jmespath==1.0.1
      - jsonpickle==3.0.1
      - kiwisolver==1.4.4
      - knack==0.10.1
      - marshmallow==3.19.0
      - matplotlib==3.7.1
      - msal==1.22.0
      - msal-extensions==1.0.0
      - msrest==0.7.1
      - msrestazure==0.6.4
      - ndg-httpsclient==0.5.1
      - oauthlib==3.2.2
      - opencensus==0.11.2
      - opencensus-context==0.1.3
      - opencensus-ext-azure==1.1.9
      - paramiko==3.2.0
      - pathspec==0.11.1
      - pkginfo==1.9.6
      - portalocker==2.7.0
      - prompt-toolkit==3.0.38
      - protobuf==4.23.3
      - pyasn1==0.5.0
      - pyasn1-modules==0.3.0
      - pydash==5.1.2
      - pyjwt==2.7.0
      - pynacl==1.5.0
      - pyopenssl==23.2.0
      - pyparsing==3.0.9
      - pyreadline3==3.4.1
      - pyyaml==6.0
      - requests-oauthlib==1.3.1
      - rsa==4.9
      - ruamel-yaml==0.15.89
      - secretstorage==3.3.3
      - stack-data==0.6.2
      - strictyaml==1.7.3
      - tabulate==0.9.0
      - tqdm==4.65.0
      - traitlets==5.9.0
      - wcwidth==0.2.6

I got the following log message

ResolvePackageNotFound: 
  - libwebp==1.2.4=hbc33d0d_1
  - python-fastjsonschema==2.16.2=py311haa95532_0
  - numexpr==2.8.4=py311h1fcbade_1
  - pytz==2022.7=py311haa95532_0
  - bottleneck==1.3.5=py311h5bb9823_0
  - libffi==3.4.4=hd77b12b_0
  - cffi==1.15.1=py311h2bbff1b_3
  - attrs==22.1.0=py311haa95532_0
  - ca-certificates==2023.01.10=haa95532_0
  - icc_rt==2022.1.0=h6049295_2
  - jpeg==9e=h2bbff1b_1
  - tk==8.6.12=h2bbff1b_0
  - mkl==2023.1.0=h8bd8f75_46356
  - terminado==0.17.1=py311haa95532_0
  - joblib==1.1.1=py311haa95532_0
  - jupyter_core==5.3.0=py311haa95532_0
  - requests==2.29.0=py311haa95532_0
  - mkl_random==1.2.2=py311hf62ec03_1
  - libpng==1.6.39=h8cc25b3_0
  - webencodings==0.5.1=py311haa95532_1
  - debugpy==1.5.1=py311hd77b12b_0
  - pygments==2.15.1=py311haa95532_1
  - nbformat==5.7.0=py311haa95532_0
  - pysocks==1.7.1=py311haa95532_0
  - matplotlib-inline==0.1.6=py311haa95532_0
  - mpmath==1.2.1=py311haa95532_0
  - platformdirs==2.5.2=py311haa95532_0
  - typing-extensions==4.5.0=py311haa95532_0
  - beautifulsoup4==4.12.2=py311haa95532_0
  - bzip2==1.0.8=he774522_0
  - argon2-cffi-bindings==21.2.0=py311h2bbff1b_0
  - jupyterlab_server==2.22.0=py311haa95532_0
  - scikit-learn==1.2.2=py311hd77b12b_0
  - win_inet_pton==1.1.0=py311haa95532_0
  - pywinpty==2.0.10=py311h5da7b33_0
  - certifi==2023.5.7=py311haa95532_0
  - ipykernel==6.19.2=py311h86cfffd_0
  - tinycss2==1.2.1=py311haa95532_0
  - jupyterlab==3.5.3=py311haa95532_0
  - giflib==5.2.1=h8cc25b3_3
  - libwebp-base==1.2.4=h2bbff1b_1
  - pyrsistent==0.18.0=py311h2bbff1b_0
  - winpty==0.4.3=4
  - colorama==0.4.6=py311haa95532_0
  - nbclient==0.5.13=py311haa95532_0
  - libiconv==1.16=h2bbff1b_2
  - soupsieve==2.4=py311haa95532_0
  - websocket-client==0.58.0=py311haa95532_4
  - libsodium==1.0.18=h62dcd97_0
  - python==3.11.3=h966fe2a_0
  - networkx==2.8.4=py311haa95532_1
  - psutil==5.9.0=py311h2bbff1b_0
  - sqlite==3.41.2=h2bbff1b_0
  - tbb==2021.8.0=h59b6b97_0
  - freetype==2.12.1=ha860e81_0
  - vc==14.2=h21ff451_1
  - pywin32==305=py311h2bbff1b_0
  - typing_extensions==4.5.0=py311haa95532_0
  - pyzmq==25.0.2=py311hd77b12b_0
  - lerc==3.0=hd77b12b_0
  - jupyter_server==1.23.4=py311haa95532_0
  - mkl_fft==1.3.6=py311hf62ec03_1
  - setuptools==66.0.0=py311haa95532_0
  - brotlipy==0.7.0=py311h2bbff1b_1002
  - nest-asyncio==1.5.6=py311haa95532_0
  - lz4-c==1.9.4=h2bbff1b_0
  - numpy-base==1.24.3=py311hd01c5d8_1
  - tornado==6.2=py311h2bbff1b_0
  - libdeflate==1.17=h2bbff1b_0
  - libxslt==1.1.37=h2bbff1b_0
  - openssl==1.1.1t=h2bbff1b_0
  - entrypoints==0.4=py311haa95532_0
  - prometheus_client==0.14.1=py311haa95532_0
  - nbclassic==0.5.5=py311haa95532_0
  - pillow==9.4.0=py311hd77b12b_0
  - comm==0.1.2=py311haa95532_0
  - pip==23.0.1=py311haa95532_0
  - sympy==1.11.1=py311haa95532_0
  - jsonschema==4.17.3=py311haa95532_0
  - vs2015_runtime==14.27.29016=h5e58377_2
  - filelock==3.9.0=py311haa95532_0
  - notebook-shim==0.2.2=py311haa95532_0
  - mistune==0.8.4=py311h2bbff1b_1000
  - zlib==1.2.13=h8cc25b3_0
  - anyio==3.5.0=py311haa95532_0
  - notebook==6.5.4=py311haa95532_0
  - urllib3==1.26.15=py311haa95532_0
  - mkl-service==2.4.0=py311h2bbff1b_1
  - zstd==1.5.5=hd43e919_0
  - packaging==23.0=py311haa95532_0
  - jinja2==3.1.2=py311haa95532_0
  - libuv==1.44.2=h2bbff1b_0
  - scipy==1.10.1=py311hc1ccb85_1
  - jupyter_client==8.1.0=py311haa95532_0
  - markupsafe==2.1.1=py311h2bbff1b_0
  - intel-openmp==2023.1.0=h59b6b97_46319
  - idna==3.4=py311haa95532_0
  - xz==5.4.2=h8cc25b3_0
  - sniffio==1.2.0=py311haa95532_1
  - pandas==1.5.3=py311heda8569_0
  - nbconvert==6.5.4=py311haa95532_0
  - libtiff==4.5.0=h6c2663c_2
  - babel==2.11.0=py311haa95532_0
  - libxml2==2.10.3=h0ad7f3c_0
  - tomli==2.0.1=py311haa95532_0
  - numpy==1.24.3=py311hdab7c0b_1
  - lxml==4.9.2=py311h2bbff1b_0
  - zeromq==4.3.4=hd77b12b_0
  - wheel==0.38.4=py311haa95532_0

The command '/bin/sh -c ldconfig /usr/local/cuda/lib64/stubs && conda env create -p /azureml-envs/azureml_9484628e7f14c08883270b9203fe5e19 -f azureml-environment-setup/mutated_conda_dependencies.yml && rm -rf "$HOME/.cache/pip" && conda clean -aqy && CONDA_ROOT_DIR=$(conda info --root) && rm -rf "$CONDA_ROOT_DIR/pkgs" && find "$CONDA_ROOT_DIR" -type d -name __pycache__ -exec rm -rf {} + && ldconfig' returned a non-zero code: 1
2023/06/23 12:00:00 Container failed during run: acb_step_0. No retries remaining.
failed to run step ID: acb_step_0: exit status 1

Run ID: cbc failed after 2m5s. Error: failed during run, err: exit status 1

Answer 1

@Faisal Ahmed Is something wrong with the package names that are in error list? I see an extra "=" in all the package names. Here are some from the list.

  - libwebp==1.2.4=hbc33d0d_1
  - python-fastjsonschema==2.16.2=py311haa95532_0
  - numexpr==2.8.4=py311h1fcbade_1
  - pytz==2022.7=py311haa95532_0
  - bottleneck==1.3.5=py311h5bb9823_0

Could you just add dependencies like below format and check if it works. Ex. for python

python=3.7.6

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.