"no module named azure.storage" while using ScriptRunConfig to submit run.

Question

"no module named azure.storage" while using ScriptRunConfig to submit run.

Priya Katta 1

I am trying to download pickle files from blob container and using ScriptRunConfig object to submit a Run.

I am stuck and getting the following error:

ModuleNotFoundError: No module named 'azure.storage'

Any help is appreciated please.......

my environment.yml file consists of the following below:

name: azuremlenv
dependencies:
- python=3.8
- pip=21.0.1
- pip:
  - azureml-defaults
  - azureml-core
  - azureml-mlflow
  - azureml-sdk
  - azure-storage
  - azure-storage-blob
  - azure-mgmt-datafactory
  - azure-functions
  - azure-functions-durable
  - scikit-learn==0.24.1
  - pandas==1.2.4
  - seaborn==0.11.1
  - tqdm==4.61.2
  - matplotlib==3.3.4
  - pandas-schema==0.3.6

YutongTie-MSFT 53,966 Reputation points Moderator

2022-05-17T05:04:19.233+00:00

Hello @Priya Katta

May I know how your code looks like? My concern is you may install azure.storage successfully in your env but you are not running your code in this env. If this is not confidential, could you please share it to us? Or you can share the guidance/ document you are following to so that I can reproduce it.

Thanks a lot.

Regards,
Yutong

Priya Katta 1

Hi Yutong,

The code is as below:

env = Environment.from_conda_specification("ufm_env", file_path="./environment.yml")
env.docker.base_image = "mcr.microsoft.com/azureml/curated/sklearn-1.0-ubuntu20.04-py38-cpu:18"
env.python.user_managed_dependencies = True
docker_config = DockerConfiguration(use_docker=True)

src = ScriptRunConfig(source_directory=SOURCE_FOLDER_PATH,
                      script=SCRIPT_FILE_TO_EXECUTE,
                      arguments=EXECUTE_ARGUMENTS,
                      compute_target=compute_target,
                      environment=vm_env)

The error I get is below:

from azure.storage.blob import BlobServiceClient\n[stderr]ModuleNotFoundError: No module named 'azure.storage'\n[stderr]\n","process_name":"python","error_file":"user_logs/std_log.txt"}], 'target': , 'category': UserError, 'error_details': [{'key': exit_codes, 'value': 1}, ], 'inner_error': null}

Your answer

YutongTie-MSFT 53,966 Reputation points Moderator

2022-05-17T05:04:19.233+00:00

Hello @Priya Katta

May I know how your code looks like? My concern is you may install azure.storage successfully in your env but you are not running your code in this env. If this is not confidential, could you please share it to us? Or you can share the guidance/ document you are following to so that I can reproduce it.

Thanks a lot.

Regards,
Yutong
Priya Katta 1 Reputation point

2022-05-17T16:06:40.037+00:00

Hi Yutong,

The code is as below:

env = Environment.from_conda_specification("ufm_env", file_path="./environment.yml") env.docker.base_image = "mcr.microsoft.com/azureml/curated/sklearn-1.0-ubuntu20.04-py38-cpu:18" env.python.user_managed_dependencies = True docker_config = DockerConfiguration(use_docker=True) src = ScriptRunConfig(source_directory=SOURCE_FOLDER_PATH, script=SCRIPT_FILE_TO_EXECUTE, arguments=EXECUTE_ARGUMENTS, compute_target=compute_target, environment=vm_env)

The error I get is below:

from azure.storage.blob import BlobServiceClient\n[stderr]ModuleNotFoundError: No module named 'azure.storage'\n[stderr]\n","process_name":"python","error_file":"user_logs/std_log.txt"}], 'target': , 'category': UserError, 'error_details': [{'key': exit_codes, 'value': 1}, ], 'inner_error': null}

Share via

"no module named azure.storage" while using ScriptRunConfig to submit run.

Your answer