Content Delivery Network analytics

Data Explorer
Logic Apps
Storage

Solution ideas

This article is a solution idea. If you'd like us to expand the content with more information, such as potential use cases, alternative services, implementation considerations, or pricing guidance, let us know by providing GitHub feedback.

This solution idea demonstrates low-latency high throughput ingestion for large volumes of Content Delivery Network (CDN) logs for building near real-time analytics dashboards.

Potential use cases

  • Log analytics
  • Time series analytics
  • IoT
  • General-purpose exploratory analytics

Architecture

Content delivery network analytics with Azure Data Explorer

Dataflow

  1. Content Delivery Network providers such as Verizon and Fastly ingest huge amounts of CDN logs into Azure Data Explorer to analyze latencies, health, and performance of CDN assets.
  2. Most CDN scenarios ingest data through Azure Storage (Blob or ADLS Gen2), which uses Azure Event Grid and triggers the ingestion pipeline to Azure Data Explorer. Alternatively you can bulk ingest the data using the LightIngest tool. You can also continuously export data to Azure Storage in compressed, partitioned parquet format and seamlessly query that data as detailed in Continuous data export overview.
  3. Azure Data Explorer provides easy to use native operators and functions to process, aggregate, and analyze time series and log data, as well as supply insights at lightning speed. You can build near real-time analytics dashboards using Azure Data Explorer dashboards, Power BI, or Grafana.
  4. Create and schedule alerts and notifications using Azure Data Explorer connector for Azure Logic Apps.

Components

Contributors

This article is maintained by Microsoft. It was originally written by the following contributors.

Principal author:

Next steps

For more information, see Azure Data Explorer documentation.