Azure Synapse: How to use Spark job reference files?

Madeline Stager 31 Reputation points
2020-12-16T18:34:01.037+00:00

I created a Spark job definition following the PySpark section of this tutorial.

https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-job-definitions#create-an-apache-spark-job-definition-for-pyspark-python

I want to update additional python files in the reference files section of the job definition and use those files in the main python job file.
I tried a few different approaches and get errors that the classed I try to reference can't be found.

How can I use the reference python files in the main job definition?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,346 questions
{count} vote