When I try to execute a script on Databricks 7.0 to write data to a table in Azure Synapse Analytics, I get an error: Parse error at line: 7, column: 30: Incorrect syntax near ''Managed Service Identity''.
I have useAzureMSI option equal to true. Using the Managed Service Identity for our storage account access is a hard requirement for us.
I worked around this by setting the spark conf to use polybase - spark.conf.set("spark.databricks.sqldw.writeSemantics", "polybase")
but I'd like to try out the new COPY command to load the data, if there is a workaround available for that. Anyone have any ideas or sample code to get the write command configured properly?