482 questions with Azure Data Explorer tags

Sort by: Updated
1 answer

How can I speed up my query on materialized view?

I want to run a simple query on a table (~100M records) with duplicates: event_table | where match_id == 12345 In order to deduplicate the table first, I created a materialized view which deduplicates using the unique id column: .create…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2024-01-26T12:00:49.65+00:00
Gavin Cheung 5 Reputation points
edited a comment 2024-02-01T11:53:43.65+00:00
Gavin Cheung 5 Reputation points
1 answer

How to cancel an async DataExportToFile operation

I started an operation using the syntax below. How do I cancel it? I've tried .cancel operation <operationid> but get the error message that DataExportToFile is not amenable to cancellation. .export async to csv( h@"<target…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2024-01-23T18:28:14.7+00:00
Srikanth Kandula 0 Reputation points Microsoft Employee
commented 2024-01-30T09:31:00.9333333+00:00
ShaikMaheer-MSFT 37,896 Reputation points Microsoft Employee
0 answers

How do i embed Azure data explorer dashboards on a web page

Hi All, I had followed the article at https://learn.microsoft.com/en-us/azure/data-explorer/kusto/api/monaco/host-web-ux-in-iframe#related-content to try embedding an Azure data explorer dashboard on a web page (ASP.NET web app with aspx page). I am…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2024-01-23T02:02:37.6233333+00:00
Domnic Christy Bakkianathan 5 Reputation points Microsoft Employee
edited a comment 2024-01-25T00:59:59.8566667+00:00
Dominic Bonar 5 Reputation points Microsoft Employee
1 answer

azure data exporer ingestion iot from iot hub not showig system properties

I cannot get message-id from system properties of iothub message. It's not present on the message despite being turned on in connection settings. I was following this manual…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2022-04-08T13:32:22.26+00:00
Pavel Nikulin 1 Reputation point
edited the question 2024-01-25T00:04:08.4166667+00:00
QuantumCache 20,031 Reputation points
1 answer

It's possible to use Kusto .set-or-append command to copy table between clusters.

I'm trying to figure out a direct approach to copy multiple tables between 2 Kusto clusters. One option I have used in the past is to copy the data to cloud storage and then ingest that data into the new table in the secondary cluster. But I would like…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2024-01-24T02:01:25.8433333+00:00
Jose Gonzalez Gongora 5 Reputation points Microsoft Employee
answered 2024-01-24T20:57:26.45+00:00
KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
2 answers One of the answers was accepted by the question author.

How to query the Entra ID or M365 logs for external sharing to a specific domain?

Folks, How can I use the built-in Kusto QL or any methods for user activity that is sharing / inviting External users to the OneDrive or SharePoint sites? Thank you.

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
SharePoint
SharePoint
A group of Microsoft Products and technologies used for sharing and managing content, knowledge, and applications.
9,672 questions
OneDrive Management
OneDrive Management
OneDrive: A Microsoft file hosting and synchronization service.Management: The act or process of organizing, handling, directing or controlling something.
1,134 questions
Microsoft Entra ID
Microsoft Entra ID
A Microsoft Entra identity service that provides identity management and access control capabilities. Replaces Azure Active Directory.
19,549 questions
asked 2024-01-22T04:34:39.5266667+00:00
EnterpriseArchitect 4,741 Reputation points
commented 2024-01-24T03:15:49.27+00:00
EnterpriseArchitect 4,741 Reputation points
2 answers

How to add message headers in ADX along with message body?

We've configured ADX with EH data connection. We're able to successfully ingest eventhub message body into our ADX database. We also need to add the message headers like correlation id, schema version, message id etc., in ADX database. How to add…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2023-12-20T00:13:21.89+00:00
Chandramohan, Srinivasan 5 Reputation points
commented 2024-01-15T23:22:06.6333333+00:00
PRADEEPCHEEKATLA-MSFT 77,516 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Resource Graph Explorer - KQL queries for Azure APP services - get properties

Hi, I am trying to get a list of all the web apps and their .net version This is the query I've written, but not getting anywhere with it - resources | where ['type'] contains "Microsoft.Web/sites" and kind == "app"  | project…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
Microsoft Graph
Microsoft Graph
A Microsoft programmability model that exposes REST APIs and client libraries to access data on Microsoft 365 services.
10,633 questions
Azure App Service
Azure App Service
Azure App Service is a service used to create and deploy scalable, mission-critical web apps.
6,901 questions
asked 2024-01-10T10:02:47.6733333+00:00
Ieuan Walker 20 Reputation points
commented 2024-01-11T10:40:04.77+00:00
Ieuan Walker 20 Reputation points
0 answers

How to fix Download Forbidden error when ingesting data using lightingest from azure blob storage to ADX

I am trying to ingest data from a blob into my ADX database. I have database admin permisson on the ADX database, and a storage blob reader permisson on the container level. I am able to list the file when running my light ingest command, but i am…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2023-12-29T08:00:38.02+00:00
Tan, Yoong Kiat 0 Reputation points
commented 2024-01-05T00:26:58.68+00:00
BhargavaGunnam-MSFT 26,226 Reputation points Microsoft Employee
2 answers

Run fbprophet from ADX without SAS keys

I have been trying our this example - trying to run fbprophet within Adx as documented here : https://learn.microsoft.com/en-us/azure/data-explorer/kusto/functions-library/series-fbprophet-forecast-fl?tabs=query-defined&pivots=azuredataexplorer We…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2023-10-25T08:43:35.9733333+00:00
SEYNAEVE Gerdy (SGI/MST) 1 Reputation point
edited an answer 2023-12-29T14:15:36.02+00:00
SEYNAEVE Gerdy (SGI/MST) 1 Reputation point
1 answer

Rename multiple folder name in data lakes

Hi, I have a typo in folder names when using adf to copy data to data lake gen2. Since the files are so big, I do not want to recopy the files. But there are so many folders names needed to be changed. Instead of doing it one by one manually, is there…

Azure SQL Database
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,349 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,390 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,588 questions
asked 2023-12-28T18:49:09.8433333+00:00
Zhu, Yueli YZ [NC] 235 Reputation points
commented 2023-12-28T19:59:14.7666667+00:00
Kumar, Mohit 0 Reputation points
1 answer One of the answers was accepted by the question author.

I would like to know if connector is available for SAP BPC?

Hi Experts, I am working on solution development to ingest data from different SAP systems to ADLS Gen 2. I have selected ADF for the integration and could see ADF connectors available for SAP BW, HANA, C2C etc. However, I don't find any information…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,349 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,588 questions
SQL Server Integration Services
SQL Server Integration Services
A Microsoft platform for building enterprise-level data integration and data transformations solutions.
2,454 questions
asked 2023-12-18T13:44:07.4133333+00:00
Sivaramakrishnan S 20 Reputation points
accepted 2023-12-27T06:56:57.8433333+00:00
Sivaramakrishnan S 20 Reputation points
1 answer

Why does my ADX cluster policy request classification fail?

I created a custom Workload Group called "ConcurrentWorkloadGroup". I then attempt to create a policy request classification with the following KQL command: .alter cluster policy request_classification '{"IsEnabled":true}' <| …

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2023-12-18T16:55:18.08+00:00
Gavin Cheung 5 Reputation points
commented 2023-12-27T06:41:02.3+00:00
ShaikMaheer-MSFT 37,896 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

KQL Query for selecting data from different table based on selection in ADX UI dashboard

Hi I have data explorer dashboard which has n number of tables and each table have data from different location, but all table's schemas are same. I am trying to create one query for charts which should fetch data from different tables based on location…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2023-11-22T06:45:23.24+00:00
Sangeetha Priya S 210 Reputation points
accepted 2023-12-26T12:36:06.5366667+00:00
Sangeetha Priya S 210 Reputation points
1 answer One of the answers was accepted by the question author.

How to use let statement scalar output in table function

Hi, I am using let statement where it gives tablename as a result based on some condition. And I am trying use that value in table() function - table(tablename). It gives me below error though I have my converted my let statement result to string using…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2023-12-20T12:30:21.1466667+00:00
Sangeetha Priya S 210 Reputation points
accepted 2023-12-26T12:35:36.6433333+00:00
Sangeetha Priya S 210 Reputation points
1 answer One of the answers was accepted by the question author.

KQL Text Aggregation

In ADX , I have a table with a column named 'Names' that contains values like the following: Names["Name1","Name2"][""]["Name1"]["Name3"]I need to create a new column that combines the values of each row…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2023-12-22T10:58:33.6+00:00
Manuprasad M N 40 Reputation points
accepted 2023-12-26T05:02:08.5266667+00:00
Manuprasad M N 40 Reputation points
1 answer

move data from one container to another in databricks

HI Expert, how we can move files from one container to another using timestamp last modified i.e. mnt/test/tes1 to mnt/test/test2

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,349 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,436 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,936 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,588 questions
asked 2023-12-11T23:23:22.1233333+00:00
Shambhu Rai 1,406 Reputation points
edited a comment 2023-12-21T11:02:40.5533333+00:00
phemanth 5,840 Reputation points Microsoft Vendor
1 answer

How can I monitor and identify ADX ingestion fails at file level by using Queued file ingestion type with SDK library ?

Hi community, I have implemented ADX Queued ingestion ( QueueIngestionLink ) to ingest timeseries data passed by csv files. The java application is implemented by using SDK library as suggested from Microsoft. I have left default ingestion policy as I…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2023-11-06T14:40:48.3566667+00:00
Galgani, Stefano 205 Reputation points
accepted 2023-12-20T13:58:49.07+00:00
Galgani, Stefano 205 Reputation points
1 answer One of the answers was accepted by the question author.

Complete the load.. If file not available databricks notebbok

Hi If there is no file in blob storage then it should complete the flow in data bricks notebook That means sometimes file is available and not in blob storage mnt/test/ empty folder... In this case flow should complete. . Files like CSV,. Txt

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,349 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,936 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,588 questions
asked 2023-12-18T04:01:30.12+00:00
Shambhu Rai 1,406 Reputation points
accepted 2023-12-19T12:41:20.0133333+00:00
Shambhu Rai 1,406 Reputation points
2 answers

KQL Has_any Operator

Hello, I need to develop a KQL query that can perform a lookup on a string array that contains different text descriptions. the lookup will be based on a set of key terms. I was hoping to leverage "has_any" operator, which almost had it…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
482 questions
asked 2023-12-14T17:59:31.0733333+00:00
Yang, Steven 151 Reputation points
commented 2023-12-19T05:04:54.32+00:00
ShaikMaheer-MSFT 37,896 Reputation points Microsoft Employee