Episode

Learn Together Microsoft Fabric Ep208: Ingest data with Spark and Microsoft Fabric notebooks

with Shabnam Watson, Kevin Chant, Nicolas Georgeault, Amit Chandak

Learn Live

Discover how to use Apache Spark and Python for data ingestion into a Microsoft Fabric lakehouse. Fabric notebooks provide a scalable and systematic solution.

Learning objectives

  • Ingest external data to Fabric lakehouses using Spark
  • Configure external source authentication and optimization
  • Load data into lakehouse as files or as Delta tables

Chapters

  • 00:00 - Introduction
  • 05:34 - Learning objectives
  • 08:17 - Connect to data with spark
  • 20:49 - Write data into a lakehouse
  • 34:01 - Write to a Delta table
  • 41:49 - Exercise - Ingest data with spark and Microsoft Fabric notebooks
  • 01:07:49 - Consider uses for ingested data
  • 01:14:20 - Knowledge check
  • 01:19:57 - Conclusion

Connect

Intermediate
Data Analyst
Data Engineer
Data Scientist
Microsoft Fabric