Integrate SQL and Apache Spark pools in Azure Synapse Analytics
Learn how to integrate SQL and Apache Spark pools in Azure Synapse Analytics.
Learning objectives
After completing this module, you will be able to:
- Describe the integration methods between SQL and Spark Pools in Azure Synapse Analytics
- Understand the use-cases for SQL and Spark Pools integration
- Authenticate in Azure Synapse Analytics
- Transfer data between SQL and Spark Pool in Azure Synapse Analytics
- Authenticate between Spark and SQL Pool in Azure Synapse Analytics
- Integrate SQL and Spark Pools in Azure Synapse Analytics
- Externalize the use of Spark Pools within Azure Synapse workspace
- Transfer data outside the Synapse workspace using SQL Authentication
- Transfer data outside the Synapse workspace using the PySpark Connector
- Transform data in Apache Spark and write back to SQL Pool in Azure Synapse Analytics
Prerequisites
Before taking this module, it is recommended that you complete the following modules:
- Data Fundamentals
- Introduction to Azure Data Factory
- Introduction to Azure Synapse Analytics