What's new in Azure Data Explorer documentation

Welcome to what's new in Azure Data Explorer. This article details new and significantly updated content in the Azure Data Explorer documentation.

August 2024

General

Article title Description
Visualize data with Azure Data Explorer dashboards Updated article. Added section explaining how the tile legend is used to interact with the data in the tile.
Ingest data from Apache Kafka into Azure Data Explorer Updated article. Added information about managed identity.

Management

Article title Description
.show data operation command New article. Learn how to use the .show data operations command to return data operations that reached a final state.

July 2024

General

Article title Description
Python plugin packages Updated article. Refreshed the list of available Python packages for the Python plugin.
Azure DevOps Task for Azure Data Explorer Updated article. Updated to include latest authentication changes in the Azure DevOps extension.

Query

Article title Description
infer_storage_schema_with_suggestions plugin New article. Describes how to use the infer_storage_schema_with_suggestions plugin to infer the optimal schema of external data.
infer_storage_schema plugin Updated article. Added description of how to use the infer_storage_schema plugin to retrieve the CSL schema string.
cosmosdb_sql_request plugin Updated article. Added token authentication method.
evaluate plugin operator Updated article. Added the ipv6_lookup plugin to the list of supported plugins.
ipv6_lookup plugin New article. Describes how to use the ipv6_lookup plugin to look up an IPv6 address in a lookup table.

June 2024

General

Article title Description
How the reservation discount is applied to Azure Data Explorer New article. Describes how the reservation discount is applied to Azure Data Explorer markup meter.
Access the data profile of a table Updated article. Refreshed steps on how to open the data profile.
Write Kusto Query Language queries in the Azure Data Explorer web UI Updated article. Refreshed steps on how to use the KQL tools in the toolbar.
Explore the samples gallery Updated article. Refreshed steps on how to navigate to other tutorials.

Query

Article title Description
cosmosdb_sql_request plugin Updated article. Added Azure Resource Manager example.

May 2024

No updates.

April 2024

Management

Article title Description
.execute cluster script command New article. Describes how to use the .execute cluster script command to execute a batch of management commands in the scope of a cluster.

March 2024

API

Article title Description
Use Kusto cmdlets in Azure PowerShell New article. Describes how to use Kusto cmdlets in Azure PowerShell.

General

Article title Description
Create an Azure Data Explorer cluster and database Updated article. Refreshed steps on how to set up Azure PowerShell to run Kusto cmdlets.
Migrate your cluster to support multiple availability zones (Preview) Updated article. Refreshed steps on how to get the list of availability zones for your cluster's region in Azure portal.

Management

Article title Description
- What are common scenarios for using table update policies
- Tutorial: Route data using table update policies
- Update policy overview
New and updated articles. Describes common use cases for how to use update table policies to perform complex transformations and route results to destination tables.
Parquet mapping Updated article. Added parquet type conversions table to provide a mapping of Parquet field types, and the table column types they can be converted to.

February 2024

General

Article title Description
- Azure Data Explorer web UI query overview
- Access the data profile of a table
New article that describes how to access the data profile of a table in the Azure Data Explorer web UI, and updated web UI query overview.
Customize Azure Data Explorer dashboard visuals Updated article. Added section on embedding images in dashboard tiles.
Create an Event Grid data connection for Azure Data Explorer Updated article. Refreshed content.
How to ingest historical data into Azure Data Explorer Updated article. Refreshed content.

Management

Article title Description
Apply row-level security on SQL external tables New article. Describes how to create a row-level security solution with Azure Data Explorer SQL external tables.
.update table command (preview) New article. Describes how to use the .update table command to perform transactional data updates.
- Stored query results
- .set stored_query_result command
- .show stored_query_result command
- .drop stored_query_result command
- stored_query_result()
New articles. Describe how to manage stored query results.
Continuous data export overview Updated article. Added section on continuous export to delta table, and refreshed limitations.

Query

Article title Description
sort operator Updated article. Added section on the use of special floating-point values.

January 2024

General

Article title Description
- Integrations overview
- Data integrations overview
- Query integrations overview
- Visualize integrations overview
New articles. Describes the available data connectors, tools, and query integrations, and updated article on the available visualize integrations.
Schema optimization best practices New article. Describes the best practices for schema design in Azure Data Explorer.

December 2023

General

Article title Description
Migrate your cluster to support multiple availability zones New article. Describes how to migrate your cluster to support multiple availability zones.

Query

Article title Description
-Scalar function types at a glance
-series_cosine_similarity()
- series_magnitude()
- series_sum()
New articles. Describes how to calculate series elements, and added to scalar functions overview.
series_dot_product() Updated article. Added section on performance optimization.

November 2023

General

Article title Description
Migrate a Virtual Network injected cluster to private endpoints (Preview) New article. Describes how to migrate a Virtual Network injected Azure Data Explorer Cluster to private endpoints.
- Ingest data from Splunk Universal Forwarder
- Ingest data with Apache Flink
- Data connectors overview
New articles that describe how to ingest data with Splunk Universal Forwarder and Apache Flink, and updated data connector overview.
Use follower databases Updated article. Update limitations for clusters using customer-managed keys.
Create Power Apps application to query data in Azure Data Explorer Updated article. Refreshed content.
Create a Microsoft Entra application registration in Azure Data Explorer Updated article. Added section on creating a Microsoft Entra service principal.

Management

Article title Description
Materialized views use cases New article. Describes common and advanced use cases for materialized views.

October 2023

General

Article title Description
- Ingest data with Fluent Bit
- Data connectors overview
New article that describes how to ingest data from Fluent Bit, and updated data connector overview with additional capabilities.
Connect a cluster behind a private endpoint to a Power BI service New article. Describes how to connect an Azure Data Explorer cluster behind a private endpoint to a Power BI service.

September 2023

General

Article title Description
- KQL graph semantics overview (Preview)
- KQL graph semantics best practices (Preview)
- Common scenarios for using KQL graph semantics (Preview)?
New articles. Describes how to use Kusto Query Language (KQL) graph semantics.
How to ingest historical data New article. Describes how to use LightIngest to ingest historical or ad hoc data into Azure Data Explorer.
- Ingest data from Splunk to Azure Data Explorer
- Data connectors overview
New article that describes how to ingest data into Azure Data Explorer from Splunk, and updated data connector overview with additional capabilities.
KQL learning resources New article. Describes the different learning resources for ramping up on KQL.
Dashboard-specific visuals New article. Describes the visualizations available in Azure Data Explorer web UI or dashboards.
Create a dashboard base query New article. Describes how to create a base query for an Azure Data Explorer dashboard.

Management

Article title Description
- .alter-merge database policy ingestionbatching command
- .alter-merge table policy ingestionbatching command
New articles. Describes how to set the ingestion batching policy.

Query

Article title Description
- Graph operators (Preview)
- graph-match operator (Preview)
- graph-to-table operator (Preview)
- make-graph operator (Preview)
New articles. Describes how to use graph operators.
Plotly (preview) New article. Describes how to visualize data using the Plotly graphics library.