How to prevent that a new blob storage container is created for each job

Jeroen Hamers (imec-OnePlanet) 20 Reputation points
2023-10-02T21:01:09.34+00:00

I have created a resource group, workspace and a compute instance. Every time I run a job a new blob storage container is created to store the Python files linked to that job, instead of using the default container azureml-blobstore-

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,618 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Diondra Peck 10 Reputation points Microsoft Employee
    2024-02-15T04:26:33+00:00

    This is expected behavior as of azure-ai-ml version 1.7.0. Code snapshot creation was transitioned from directory-based within a container to container-based within a datastore in order to accommodate users with fine RBAC (Resource Based Access Control) policies that don't permit container creation for all users of a workspace. The change wasn't announced in the 1.7.0 CHANGELOG; however, given strong user feedback and confusion about the change, we will be adding it to the CHANGELOG retroactively to create clarity: https://github.com/Azure/azure-sdk-for-python/pull/34332.

    The AzureML SDK team really appreciates the feedback and are looking to see how we can move forward in a way that maintains the RBAC benefits of the change while addressing UX concerns.

    2 people found this answer helpful.
    0 comments No comments