Summary
Apache Spark offers data engineers a powerful platform for transforming and processing data. The ability to include Spark notebooks in a pipeline enables you to automate Spark processing and integrate it into a data integration workflow.
Tip
To learn more about using Spark notebooks in an Azure Synapse Analytics pipeline, see Transform data by running a Synapse notebook in the Azure Synapse Analytics documentation.