Share via

great_expectations package

Olivier Leflere 1 Reputation point
2022-04-19T07:24:25.06+00:00

Hi,

I am trying to run great_expectations on an azure machine learning environment, but when I do so it tells me that great_expectations is not a package. My environment is defined by the following code :

creating an environment

from azureml.core.runconfig import RunConfiguration
from azureml.core.conda_dependencies import CondaDependencies
aml_run_config = RunConfiguration()
aml_run_config.target = compute_target

aml_run_config.environment.docker.enabled = True

aml_run_config.environment.docker.base_image = "mcr.microsoft.com/azureml/base:latest"

aml_run_config.environment.python.user_managed_dependencies = False
conda_dep = CondaDependencies()
conda_dep.add_conda_package("python=3.8")
conda_dep.add_conda_package("pandas")
conda_dep.add_conda_package("packaging")
conda_dep.add_conda_package('pip')

conda_dep.add_pip_package("azureml-defaults")

conda_dep.add_pip_package("great_expectations")
aml_run_config.environment.python.conda_dependencies = conda_dep

In the logs I can see that the package is being downloaded, but it is not being installed, which is kind of strange. Is there somebody who has experience with great_expectations on Azure Machine Learning?

Kind regards,

Olivier Leflere

Azure Container Instances
Azure Machine Learning

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.