Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
1 answer
One of the answers was accepted by the question author.
Regex matches are running very slow
Hi, I have a query like below - This query is running very slow. is there anyway I can speedup this query. My table is big and I am ingesting 60 billion rows in one hour. Also I have around 40 regex in the where clause, for simplicity I mentioned only…
asked 2024-03-07T23:24:43.5566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 4%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAM%3C/text%3E%3C/svg%3E)
Amritendu Mondal
20
Reputation points Microsoft Employee
accepted 2024-03-20T23:58:04.04+00:00
Amritendu Mondal
20
Reputation points Microsoft Employee
2 answers
Using Conditional Formatting/ Formula to Compare Two Dates
I am trying to compare two dates in a large data sheet as a Success or Failure depending on the Ship Date. For example, on the first line, the Ship Date is 2/29/2024 which is after the due date (-1 of 2/26/2024), making it a failure. The Expected…
asked 2024-03-19T12:49:22.49+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 32%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVC%3C/text%3E%3C/svg%3E)
Villa, Carissa
0
Reputation points
answered 2024-03-19T22:35:57.91+00:00
Sander van de Velde
28,546
Reputation points MVP
1 answer
Connecting to Azure Data Explorer with JDBC
I am trying to connect to Azure Data Explorer with JDBC using MATLAB but I keep running into the error shown in the insert below. A little bit of googling revealed that this issue could potentially be resolved by "opening port 443 and the necessary…
asked 2024-02-29T08:05:32.5666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 5%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Machiri Marodi
0
Reputation points
commented 2024-03-14T10:30:05.67+00:00
PRADEEPCHEEKATLA-MSFT
77,516
Reputation points Microsoft Employee
2 answers
how to cancel the multiple jobs created by the '.set-or-append async' command in Kusto
Hi Dear fellows, I have created plenty of failure ingestion jobs with individual operations by the '. set-or-append async' command in Kusto, and those jobs continue growing every day, thousands of times a day. I have no idea how to cancel Infinity jobs…
asked 2024-03-11T03:12:15.5566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 78%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
Max_Gu
0
Reputation points Microsoft Vendor
answered 2024-03-13T07:41:41.1166667+00:00
Sander van de Velde
28,546
Reputation points MVP
1 answer
How to faster/optimize data deduplicate process in ADX Cluster with 'take_any' and 'leftanti' operators?
Hi We are encountering a complex issue with deduplicating our data in our ADX cluster We're ingesting our data into the cluster via Auto Ingest from/with our Azure Blob, the ingestion process works super fast and is capable of scaling rapidly -- the…
asked 2024-02-28T10:48:50.0666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 89%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EOB%3C/text%3E%3C/svg%3E)
Ori Bandel
0
Reputation points
answered 2024-03-04T20:29:10.6233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
BhargavaGunnam-MSFT
26,226
Reputation points Microsoft Employee
3 answers
How can I set multiple variables inside a KQL iff statement?
I have an SQL statement like this: if @stopDate is null begin set @stopDate=dateadd(day,-1,convert(date,getdate())) set @startDate=dateadd(day,1,dateadd(month,-1,@stopDate)) end How can I convert this to KQL? I can set one variable…
asked 2022-09-03T05:38:58.103+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 78%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ET%3C/text%3E%3C/svg%3E)
Tyler
1
Reputation point
answered 2024-03-01T14:25:28.8+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(80, 82%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EU%3C/text%3E%3C/svg%3E)
User794653
0
Reputation points
2 answers
What is the best way to ingest data into ADX for Production workloads
Option A : Synapse Pipelines using Azure Data Explorer activity using ingestion statement. as mentioned here https://learn.microsoft.com/en-us/azure/data-explorer/data-factory-command-activity Option B : Synapse Notebook using Python or C# SDKs …
asked 2024-02-26T10:07:13.4233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 17%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
DataEngineer
40
Reputation points
commented 2024-02-27T07:52:01.2933333+00:00
Sander van de Velde
28,546
Reputation points MVP
1 answer
One of the answers was accepted by the question author.
How to achieve streaming ingestion for ASA input to ADX?
Hi, I've set up an ADX Dev cluster which has been configured for streaming. I created a Database and Table which both had their streamingingestion policies enabled. I used this MS Link to create an ADX output from an Azure Stream Analytics job I…
asked 2024-02-22T16:26:59.37+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(80, 8%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJH%3C/text%3E%3C/svg%3E)
Javier Huamani
20
Reputation points
accepted 2024-02-26T20:18:56.8+00:00
Javier Huamani
20
Reputation points
2 answers
Need help on generating KQL query
Currently, I am facing difficulty in constructing KQL to display a chart on our dashboard for the following requirements: Requirements: We're fetching log messages from Application Insights, which is a text as like …
asked 2024-02-16T11:07:16.56+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 43%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGP%3C/text%3E%3C/svg%3E)
Gurudas Pise
0
Reputation points
commented 2024-02-22T13:28:01.2933333+00:00
Wilko van de Velde
2,226
Reputation points
0 answers
Ingestion mapping from parquet source to Kusto using ADF copy activity failing because of mapping kind?
Hi, I have a blob storage with parquet files that I want to ingest into Kusto using copy activity in ADF V2. I have created my source dataset as parquet source. I have created my sink dataset to point to my Kusto table. I have created an ingestion…
asked 2024-02-19T01:18:40.67+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 92%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYJ%3C/text%3E%3C/svg%3E)
youssef jouan
0
Reputation points
commented 2024-02-21T18:01:41.8233333+00:00
youssef jouan
0
Reputation points
1 answer
Are there any plans to create a docker container for Kustainer / Data Explorer emulator that is compatible with MacOS on arm64?
Hi everybody. As the title says, I would greatly appreciate to use the Kustainer image on my Mac with M1 processor. I can run the linux container but it fails with an exception: /kusto/Kusto.Personal / Kusto.Personal: Exception:…
asked 2024-02-16T14:23:12.6333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 20%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EC%3C/text%3E%3C/svg%3E)
CC
5
Reputation points
commented 2024-02-21T07:26:00.5566667+00:00
PRADEEPCHEEKATLA-MSFT
77,516
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
best approach to get telemetry data for 'in real time' analysis in Power BI and create historical data at the same time
Hi, my plan is to collect telemetry data from a KQL DB stored in ADX, currently the service is retaining the data for only 30 days and my plan is to create a long retention for at least 2 years and at the same time have dashboards of the current…
asked 2024-02-14T07:08:15.71+00:00
Gustavo Adolfo Alemán Sánchez
40
Reputation points
accepted 2024-02-20T18:50:27.8766667+00:00
Gustavo Adolfo Alemán Sánchez
40
Reputation points
1 answer
How to query Kusto data with an appID and REST API using a cross-cluster join query
I am writing code for an Azure function app that query Kusto using the REST API. The function app uses an appID which has access to various clusters in the tenant. To use the API, you of course need a bearer token, which works. A simple query to the…
asked 2024-02-13T00:23:08.44+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 23%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDW%3C/text%3E%3C/svg%3E)
David Williams (TATA CONSULTANCY SERVICES LTD)
0
Reputation points Microsoft Vendor
commented 2024-02-20T05:10:50.5066667+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
What is the capacity for storing data in a Azure Data Explorer Database?
How does storage work with Azure Data Explorer in terms of capacity? For example: In the following document it is described as separating computing and storage spaces. https://learn.microsoft.com/en-us/azure/data-explorer/how-it-works#data-storage The…
asked 2024-02-15T10:58:53.3833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 44%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETS%3C/text%3E%3C/svg%3E)
tevin.sales
20
Reputation points
accepted 2024-02-19T02:08:31.23+00:00
tevin.sales
20
Reputation points
2 answers
One of the answers was accepted by the question author.
Azure Function connection string to Azure Data Explorer
Hi, I do have an Azure Function in C# with Kusto bindings to get data from Azure Data Explorer, in my local.settings.json I added the connection string like this: "ConnectionStrings"``: { "KustoConnectionString":…
asked 2024-02-16T08:21:39.08+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 90%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERP%3C/text%3E%3C/svg%3E)
Rene Prins
46
Reputation points
accepted 2024-02-16T18:08:06.2866667+00:00
Rene Prins
46
Reputation points
2 answers
How to convert decimal number into binary number in Azure data explorer?
I not able to find adx decimal number conversion function. i am trying to convert 20321 [decimal] to binary
asked 2024-01-19T09:56:55.3+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 3%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESJ%3C/text%3E%3C/svg%3E)
Shubham Jaunjal
0
Reputation points
answered 2024-02-13T14:01:25.8033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(80, 17%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESE%3C/text%3E%3C/svg%3E)
Slaghuis, Eric
0
Reputation points
1 answer
Is there a way to deploy KQL - Time Series Query to get alerts for anomalies?
We have a KQL query that reads last 365 days of data from custom table (Log analytics workspace) and using Time-series functions it calculates anomalies in it. Now we are looking for deploying this query to get an alert email if there is anomaly. Is it…
asked 2024-02-07T14:35:49.07+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 30%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDM%3C/text%3E%3C/svg%3E)
D Mallikarjuna Reddy
96
Reputation points
commented 2024-02-12T18:22:11.9166667+00:00
BhargavaGunnam-MSFT
26,226
Reputation points Microsoft Employee
1 answer
.show queries, how far back do queries get stored?
Hi, I'm using the .show queries function to monitor how many times the database gets queried. I've notice there isn't anything before January ( there should be). Does ADX only keep the queries for 1 month? If so, is there a way to extend this time?
asked 2024-02-05T02:41:57.6233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 46%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECF%3C/text%3E%3C/svg%3E)
Cheah, Felix FC
0
Reputation points
commented 2024-02-08T23:37:56.89+00:00
BhargavaGunnam-MSFT
26,226
Reputation points Microsoft Employee
2 answers
how to backup databases in Azure data explorer ?
Hi all, I have setup Azure data explorer, created databases . is there a way to backup the databases ? Thanks Ramesh M
asked 2021-08-19T10:54:12.85+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 12%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
Ramesh
1
Reputation point
answered 2024-02-06T14:19:09.7+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 97%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEA%3C/text%3E%3C/svg%3E)
Eliseo Augusto Ramos Pinzon (Grupo Cinte)
0
Reputation points
1 answer
Why Anamoly score is higher than 100? Azure KQL
I am using KQL (make-series) to understand if there is any anomalies in my data. And I can see that few of them have anomaly score much higher than 100. I thought anomaly score is 0(low) to 100(high). Please help me in understanding the Anomaly score.…
asked 2024-01-30T16:31:35.1666667+00:00
D Mallikarjuna Reddy
96
Reputation points
commented 2024-02-01T17:05:48.16+00:00
Sander van de Velde
28,546
Reputation points MVP