Episode

Learn Together Microsoft Fabric Ep203: Work with Delta Lake tables in Microsoft Fabric

with Charley Hanania, Tom Martens, Nicky van Vroenhoven, Bernat Agulló

Learn Live

Tables in a Microsoft Fabric lakehouse are based on the Delta Lake storage format commonly used in Apache Spark. By using the enhanced capabilities of delta tables, you can create advanced analytics solutions.

Learning objectives

  • Understand Delta Lake and delta tables in Microsoft Fabric
  • Create and manage delta tables using Spark
  • Use Spark to query and transform data in delta tables
  • Use delta tables with Spark structured streaming

Chapters

  • 00:00 - Introduction
  • 03:44 - Fabric Career Hub
  • 10:52 - Learning objectives
  • 12:01 - Understand Delta Lake
  • 21:20 - Why the need for ACID?
  • 28:45 - What's ACID?
  • 29:00 - Inside Delta Parquet Format
  • 29:50 - Inside the Apache Parquet Format
  • 37:37 - Create delta tables
  • 52:31 - Use time travel to work with table versioning
  • 55:51 - Use delta tables with streaming data
  • 58:07 - Exercise - Use delta tables in Apache Spark
  • 01:23:59 - Summary

Connect

Intermediate
Data Analyst
Data Engineer
Microsoft Fabric