How can I speed up my query on materialized view?
I want to run a simple query on a table (~100M records) with duplicates: event_table | where match_id == 12345 In order to deduplicate the table first, I created a materialized view which deduplicates using the unique id column: .create…
How to cancel an async DataExportToFile operation
I started an operation using the syntax below. How do I cancel it? I've tried .cancel operation <operationid> but get the error message that DataExportToFile is not amenable to cancellation. .export async to csv( h@"<target…
How do i embed Azure data explorer dashboards on a web page
Hi All, I had followed the article at https://learn.microsoft.com/en-us/azure/data-explorer/kusto/api/monaco/host-web-ux-in-iframe#related-content to try embedding an Azure data explorer dashboard on a web page (ASP.NET web app with aspx page). I am…
azure data exporer ingestion iot from iot hub not showig system properties
I cannot get message-id from system properties of iothub message. It's not present on the message despite being turned on in connection settings. I was following this manual…
It's possible to use Kusto .set-or-append command to copy table between clusters.
I'm trying to figure out a direct approach to copy multiple tables between 2 Kusto clusters. One option I have used in the past is to copy the data to cloud storage and then ingest that data into the new table in the secondary cluster. But I would like…
How to query the Entra ID or M365 logs for external sharing to a specific domain?
Folks, How can I use the built-in Kusto QL or any methods for user activity that is sharing / inviting External users to the OneDrive or SharePoint sites? Thank you.
How to add message headers in ADX along with message body?
We've configured ADX with EH data connection. We're able to successfully ingest eventhub message body into our ADX database. We also need to add the message headers like correlation id, schema version, message id etc., in ADX database. How to add…
Resource Graph Explorer - KQL queries for Azure APP services - get properties
Hi, I am trying to get a list of all the web apps and their .net version This is the query I've written, but not getting anywhere with it - resources | where ['type'] contains "Microsoft.Web/sites" and kind == "app" | project…
How to fix Download Forbidden error when ingesting data using lightingest from azure blob storage to ADX
I am trying to ingest data from a blob into my ADX database. I have database admin permisson on the ADX database, and a storage blob reader permisson on the container level. I am able to list the file when running my light ingest command, but i am…
Run fbprophet from ADX without SAS keys
I have been trying our this example - trying to run fbprophet within Adx as documented here : https://learn.microsoft.com/en-us/azure/data-explorer/kusto/functions-library/series-fbprophet-forecast-fl?tabs=query-defined&pivots=azuredataexplorer We…
Rename multiple folder name in data lakes
Hi, I have a typo in folder names when using adf to copy data to data lake gen2. Since the files are so big, I do not want to recopy the files. But there are so many folders names needed to be changed. Instead of doing it one by one manually, is there…
I would like to know if connector is available for SAP BPC?
Hi Experts, I am working on solution development to ingest data from different SAP systems to ADLS Gen 2. I have selected ADF for the integration and could see ADF connectors available for SAP BW, HANA, C2C etc. However, I don't find any information…
Why does my ADX cluster policy request classification fail?
I created a custom Workload Group called "ConcurrentWorkloadGroup". I then attempt to create a policy request classification with the following KQL command: .alter cluster policy request_classification '{"IsEnabled":true}' <| …
KQL Query for selecting data from different table based on selection in ADX UI dashboard
Hi I have data explorer dashboard which has n number of tables and each table have data from different location, but all table's schemas are same. I am trying to create one query for charts which should fetch data from different tables based on location…
How to use let statement scalar output in table function
Hi, I am using let statement where it gives tablename as a result based on some condition. And I am trying use that value in table() function - table(tablename). It gives me below error though I have my converted my let statement result to string using…
KQL Text Aggregation
In ADX , I have a table with a column named 'Names' that contains values like the following: Names["Name1","Name2"][""]["Name1"]["Name3"]I need to create a new column that combines the values of each row…
move data from one container to another in databricks
HI Expert, how we can move files from one container to another using timestamp last modified i.e. mnt/test/tes1 to mnt/test/test2
How can I monitor and identify ADX ingestion fails at file level by using Queued file ingestion type with SDK library ?
Hi community, I have implemented ADX Queued ingestion ( QueueIngestionLink ) to ingest timeseries data passed by csv files. The java application is implemented by using SDK library as suggested from Microsoft. I have left default ingestion policy as I…
Complete the load.. If file not available databricks notebbok
Hi If there is no file in blob storage then it should complete the flow in data bricks notebook That means sometimes file is available and not in blob storage mnt/test/ empty folder... In this case flow should complete. . Files like CSV,. Txt
KQL Has_any Operator
Hello, I need to develop a KQL query that can perform a lookup on a string array that contains different text descriptions. the lookup will be based on a set of key terms. I was hoping to leverage "has_any" operator, which almost had it…