Azure Data Factory: Missing data in the Monitor Dashboard for Data Factory Contributor role
Observed a disparity in the Monitor Dashboard view for the Azure Data Factory instance between: user with Owner role at subscription scope, and, user with Data Factory Contributor role at resource group scope From the account with Owner…
spin up 20 vms
what is the best practice to spin 20-30 vms on Azure?
Use elapsed time for inbound/backend/outbound from trace as variables.
Hi, In Azure APIM when doing trace you notice that there are a kind of trace json structure. Is it possible to get hand of this trace in the policy editor? Our goal is to log how much time each request take so we have to add inboud/backend/outbound…
Issue in accessing delta table in datalake gen2 storage account with databricks cluster (latest stable version)
Recently, i am encountering an issue in the databricks cluster where it could not accessing the delta table (unmanaged delta table) which parquet files are stored in the azure datalake gen2 storage account. The issue is it could not read/update from the…
Data factory monitoring activity runs runtime consolidation report
Hello team, I have a master pipeline which has For Each and inside the loop, it has more than 10 activities. How/where to find the time taken of each activity run in consolidation. For ex:- Master For Each Iteration 1 Activity 1 Activity 2 …
Maximum Results in Log Analytics Workspace
I have a query for Azure AD logs in my Log Analytics workspace as follows (IP changed): set notruncation; SigninLogs | where IPAddress != '1.2.3.4' |summarize SigninCount = count() by Identity, tostring(LocationDetails.city), AppDisplayName,…
Azure KeyVault left with stale reference in access policies
I assign an access policy for a managed identity to a keyvault via ARM template. When the identity is deleted, the access policy is NOT removed automatically from the KV and so a stale reference is left behind. Is this expected? Shouldn't the reference…
Question: distinction between Modules and Models in Designer
In Azure ML, under designer, there are 3 categories: Datasets Modules Models Datasets are pretty straightforward, but I don't understand the distinction between Modules and Models. As an ML researcher, when I think of a "model", I…
Bug report: can't parametrize # hidden node or momentum in NN regression model
I'm using the NN regression model in Azure ML Designer, but it appears to have a bug. If I switch trainer mode to ParameterRange, it allows me to use a semicolon-separated list of hyperparameters for learning rate and epochs. However, I'm unable to use a…
Feature request: more customizability in builtin models
In Azure ML Designer, I would like to customize and parametrize other aspects of the models. For example, in the NN Regression model, I would like to try various optimizers (Adam, Adagrad, SGD) and activation functions (ReLU, Sigmoid, Tanh).
Feature request: module for handling timestamps
In Azure ML Designer, there are dozens of builtin Modules for data transformation, but none of them can handle timestamps. What I'm looking for is a module in which the user: Selects which column of the input dataset contains a timestamp Selects…
Feature request: models only support single prediction column
Many machine learning tasks involve input data in the form of scalars, vectors, matrices, and higher-order tensors. Similarly, the output predictions are often in the same format. The builtin NN regression model in Azure ML Designer only supports scalar…
Bug report: Apply Math Operation doesn't cache and reuse results from previous run
In Azure ML Designer, I have a complex data preprocessing pipeline. One of the main features of Designer pipelines is that they are supposed to cache the results of each run, so that they don't need to be re-executed every time if nothing that they…
Data Factory ForEach performance questions with REST API GET requests
I have a pipeline that has a Lookup activity that is querying a single column of data from an Azure SQL table, fetching the first 1000 rows of data. This input is then being used in a ForEach activity in order to use the values in a string…
Read Passport MRZ code
Kind Regards, I'm testing congnitive services for read text in a passport puctually the MRZ code that they used to have, and i follow yours examples specifically this…
LDAP from premises to AADS
aadds-vnet hosts the directory servers on 10.0.0.0/24 There is an option to add a firewall - but creating one doesn't include aadds-vnet The goal is an IPsec VPN from premises LAN to aadds-vnet, to allow LDAP query from a Synology Diskstation, or to…
How to get transliteration suggestion
Hello all, I am using Azure Translator for transliteration. It's working fine for transliterating from one language to other (for me English to Hindi), but I want to get list of suggestions Like : when I'm sending a request for transliterating the…
Azure Identity Authentication error "invalid signature" with React + Core Web API
Anyone know how I can go about finding out why I receive the following error: Exception thrown: 'Microsoft.IdentityModel.Tokens.SecurityTokenInvalidSignatureException' in System.Identity.Model.Tokens.Jwt.dll I'm building a React single page app that…
How to make external WEBAPI call from ADX code?
In the documentation we can find 'callout policy' for 'webapi' https://learn.microsoft.com/bs-latn-ba/azure/data-explorer/kusto/management/calloutpolicy *Azure Data Explorer clusters can communicate with external services in many different…
Application logging for Azure Functions in Python
How do you enable application logging for (serverless) function apps that have been deployed to Azure - written in Python (using VS Code). For example, this line appears in the example code: logging.info('Python HTTP trigger function processed a…