Anomaly detection on streaming data using Azure Databricks

In our previous episodes of the AI Show, we've learned all about the Azure Anomaly detector, how to bring the service on premises, and some awesome tips and tricks for getting the service to work well for you. In this episode of the AI Show Qun Ying shows us how to build an end-to-end solution using the Anomaly Detector and Azure Databricks. This step by step demo detects numerical anomalies from streaming data coming through Azure Event Hubs.

Additional Information Links:

Re-Visit Your Favorite Part of the Video:

  • [00:74] The business problem of the demo solution.
  • [01:18] The architecture of the solution.
  • [02:25] Solution prerequisites and resource setup.
  • [06:11] Code walkthrough of sending tweets to Event Hubs.
  • [07:08] Code walkthrough of reading tweets from Event Hubs.
  • [09:25] Code walkthrough of data aggregation and storing to delta.
  • [11:28] Code walkthrough of anomaly detection with Anomaly Detector.

The AI Show's Favorite Links: