Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,704 questions
Network Isolation for Storage Accounts impact Compute Instance and Cluster
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 33%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENK%3C/text%3E%3C/svg%3E)
Naresh Kumar Penta
0
Reputation points Microsoft Employee
is anyone affected by the requirement of Network Isolation for Storage Accounts? we are trying to move to selected networks on AML storage account. how do we whitelist AML computes? both Compute instance and clusters are affected and pipelines are breaking when we try to add firewall rules.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 74%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAM%3C/text%3E%3C/svg%3E)
AshokPeddakotla-MSFT 30,076 Reputation points2024-06-26T07:01:31.04+00:00 Naresh Kumar Penta Greetings!
Can you add more details about the issue you are facing?
Did you check this documentation Plan for network isolation already?
-
Naresh Kumar Penta 0 Reputation points Microsoft Employee
2024-06-26T14:19:33.7733333+00:00 Error Code: ScriptExecution.StreamAccess.Authentication Native Error: error in streaming from input data sources StreamError(PermissionDenied(Some(This request is not authorized to perform this operation.))) => permission denied when access stream. Reason: Some(This request is not authorized to perform this operation.) PermissionDenied(Some(This request is not authorized to perform this operation.)) Error Message: Authentication failed when trying to access the stream. Make sure you have correct permissions set up. Ok(This request is not authorized to perform this operation.)| session_id=339f7776-2a57-42ae-88d3-9d022593ac46
[2024-06-25 21:35:20Z] ReuseHash: e07830c3-2d37-403a-9b23-ebdcb37926d9EFQCOAVIncaDuOyoNXhFJz0A/5ys2wZc1LuOPiXrytc=, JobDefinitionToHash: {"Configuration":{"Command":"python infer.py --test_dataset $AZUREML_DATAREFERENCE_test_dataset --model_name BFtickets_pipeline_MLmodel --output_dataset DatasetOutputConfig:output_dataset --output_dataset_name BFticketProjections-output","UseAbsolutePath":false,"Framework":"Python","Communicator":"None","Target":"coistaffing-dev-cpu-compute","InputAssets":{"test_dataset":{"Asset":{"AssetId":"azureml://locations/westus/workspaces/e07830c3-2d37-403a-9b23-ebdcb37926d9/data/MLFutureBFInputs/versions/1","Type":"MLTable"},"Mechanism":"Direct","EnvironmentVariableName":"AZURE_ML_INPUT_test_dataset","Overwrite":true,"Options":{"IsEvalMode":"False","ReadWrite":"False","ForceFolder":"False"}}},"OutputData":{"output_dataset":{"OutputLocation":{"Uri":{"Path":"azureml://datastores/workspaceblobstore/paths/azureml/${{name}}/output_dataset/","IsFile":false},"Type":"UriFolder"},"Mechanism":"Mount","AdditionalOptions":{"RegistrationOptions":{}},"EnvironmentVariableName":"AZURE_ML_OUTPUT_output_dataset"}},"NodeCount":1,"CredentialPassthrough":false,"Environment":{"Name":"dctm-inference-env","Version":"1"},"History":{"OutputCollection":true,"DirectoriesToWatch":["logs"],"EnableMLflowTracking":false},"Spark":{},"ParallelTask":{"MaxRetriesPerWorker":0,"WorkerCountPerNode":1},"BatchAi":{"NodeCount":0},"AmlCompute":{"RetainCluster":false,"ClusterMaxNodeCount":1},"AISuperComputer":{"InstanceType":"D2","ImageVersion":"pytorch-1.7.0","Interactive":false,"EnableAzmlInt":true,"SLATier":"Standard"},"KubernetesCompute":{},"Tensorflow":{"WorkerCount":0,"ParameterServerCount":0},"Mpi":{"ProcessCountPerNode":1},"PyTorch":{},"Hdi":{"YarnDeployMode":"None"},"ContainerInstance":{"CpuCores":2.0,"MemoryGb":3.5},"Docker":{"UseDocker":true,"SharedVolumes":true,"ShmSize":"2g"},"Cmk8sCompute":{},"GlobalJobDispatcher":{"MyResourceOnly":false,"LowPriorityVMTolerant":true},"CommandReturnCodeConfig":{"ReturnCode":"Zero"},"EnvironmentVariables":{"AZUREML_PARAMETER_model_base_name":"BFtickets_pipeline_MLmodel","AZUREML_PARAMETER_Node_Count":"1"},"DataBricks":{"Workers":0,"MinimumWorkerCount":0,"MaxMumWorkerCount":0,"SparkVersion":"4.0.x-scala2.11","NodeTypeId":"Standard_D3_v2","TimeoutSeconds":0}},"SnapshotId":"3e61eb71-9e36-40ca-a590-2f195b1e14b5"}
[2024-06-25 21:35:20Z] Starting run in Execution Service
[2024-06-25 21:35:20Z] RunId:[9bc9f6e0-7e35-4ef9-a154-5dfc7d150386] ParentRunId:[2c37a08d-5791-4e79-887f-f914c1691aca] ComputeTarget:[AmlCompute]
[2024-06-25 21:35:20Z] The latency of ESCloud submitting an ES job returning 'Submitted' status : 1699.336ms
[2024-06-25 21:35:23Z] Job is in progress. Execution status: Preparing.
[2024-06-25 21:35:24Z] Job is in progress. Execution status: Queued.
[2024-06-25 21:35:25Z] Job is in progress. Execution status: Queued.
[2024-06-25 21:37:21Z] Job is in progress. Execution status: Queued.
[2024-06-25 21:38:08Z] Job is in progress. Execution status: Running.
[2024-06-25 21:39:22Z] Job is in progress. Execution status: Running.
-
Naresh Kumar Penta 0 Reputation points Microsoft Employee
2024-06-26T14:21:43.2066667+00:00 Error Code: ScriptExecution.StreamAccess.Authentication Native Error: error in streaming from input data sources StreamError(PermissionDenied(Some(This request is not authorized to perform this operation.))) => permission denied when access stream. Reason: Some(This request is not authorized to perform this operation.) PermissionDenied(Some(This request is not authorized to perform this operation.)) Error Message: Authentication failed when trying to access the stream. Make sure you have correct permissions set up. Ok(This request is not authorized to perform this operation.)| session_id=339f7776-2a57-42ae-88d3-9d022593ac46
[2024-06-25 21:35:20Z] ReuseHash: e07830c3-2d37-403a-9b23-ebdcb37926d9EFQCOAVIncaDuOyoNXhFJz0A/5ys2wZc1LuOPiXrytc=, JobDefinitionToHash: {"Configuration":{"Command":"python infer.py --test_dataset $AZUREML_DATAREFERENCE_test_dataset --model_name BFtickets_pipeline_MLmodel --output_dataset DatasetOutputConfig:output_dataset --output_dataset_name BFticketProjections-output","UseAbsolutePath":false,"Framework":"Python","Communicator":"None","Target":"coistaffing-dev-cpu-compute","InputAssets":{"test_dataset":{"Asset":{"AssetId":"azureml://locations/westus/workspaces/e07830c3-2d37-403a-9b23-ebdcb37926d9/data/MLFutureBFInputs/versions/1","Type":"MLTable"},"Mechanism":"Direct","EnvironmentVariableName":"AZURE_ML_INPUT_test_dataset","Overwrite":true,"Options":{"IsEvalMode":"False","ReadWrite":"False","ForceFolder":"False"}}},"OutputData":{"output_dataset":{"OutputLocation":{"Uri":{"Path":"azureml://datastores/workspaceblobstore/paths/azureml/${{name}}/output_dataset/","IsFile":false},"Type":"UriFolder"},"Mechanism":"Mount","AdditionalOptions":{"RegistrationOptions":{}},"EnvironmentVariableName":"AZURE_ML_OUTPUT_output_dataset"}},"NodeCount":1,"CredentialPassthrough":false,"Environment":{"Name":"dctm-inference-env","Version":"1"},"History":{"OutputCollection":true,"DirectoriesToWatch":["logs"],"EnableMLflowTracking":false},"Spark":{},"ParallelTask":{"MaxRetriesPerWorker":0,"WorkerCountPerNode":1},"BatchAi":{"NodeCount":0},"AmlCompute":{"RetainCluster":false,"ClusterMaxNodeCount":1},"AISuperComputer":{"InstanceType":"D2","ImageVersion":"pytorch-1.7.0","Interactive":false,"EnableAzmlInt":true,"SLATier":"Standard"},"KubernetesCompute":{},"Tensorflow":{"WorkerCount":0,"ParameterServerCount":0},"Mpi":{"ProcessCountPerNode":1},"PyTorch":{},"Hdi":{"YarnDeployMode":"None"},"ContainerInstance":{"CpuCores":2.0,"MemoryGb":3.5},"Docker":{"UseDocker":true,"SharedVolumes":true,"ShmSize":"2g"},"Cmk8sCompute":{},"GlobalJobDispatcher":{"MyResourceOnly":false,"LowPriorityVMTolerant":true},"CommandReturnCodeConfig":{"ReturnCode":"Zero"},"EnvironmentVariables":{"AZUREML_PARAMETER_model_base_name":"BFtickets_pipeline_MLmodel","AZUREML_PARAMETER_Node_Count":"1"},"DataBricks":{"Workers":0,"MinimumWorkerCount":0,"MaxMumWorkerCount":0,"SparkVersion":"4.0.x-scala2.11","NodeTypeId":"Standard_D3_v2","TimeoutSeconds":0}},"SnapshotId":"3e61eb71-9e36-40ca-a590-2f195b1e14b5"}
[2024-06-25 21:35:20Z] Starting run in Execution Service
[2024-06-25 21:35:20Z] RunId:[9bc9f6e0-7e35-4ef9-a154-5dfc7d150386] ParentRunId:[2c37a08d-5791-4e79-887f-f914c1691aca] ComputeTarget:[AmlCompute]
[2024-06-25 21:35:20Z] The latency of ESCloud submitting an ES job returning 'Submitted' status : 1699.336ms
[2024-06-25 21:35:23Z] Job is in progress. Execution status: Preparing.
[2024-06-25 21:35:24Z] Job is in progress. Execution status: Queued.
[2024-06-25 21:35:25Z] Job is in progress. Execution status: Queued.
[2024-06-25 21:37:21Z] Job is in progress. Execution status: Queued.
[2024-06-25 21:38:08Z] Job is in progress. Execution status: Running.
[2024-06-25 21:39:22Z] Job is in progress. Execution status: Running.
Sign in to comment