Spark SQL DML statements with Delta tables

Serverless SQL 216 Reputation points MVP
2020-05-27T21:21:35.157+00:00

I am getting an unspecified error when running UPDATE, DELETE and MERGE sql statements on Delta tables when using Spark SQL APIs. I can use Scala APIs fine, I’m wondering if anyone else is having the same issue?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,674 questions
0 comments No comments
{count} vote

2 answers

Sort by: Most helpful
  1. Euan Garden 136 Reputation points
    2020-05-28T01:39:01.077+00:00

    You can see here that SQL based DML is mostly not supported in the LF version of Delta Lake, it will come in the future.

    https://docs.delta.io/latest/quick-start.html#create-a-table

    -Euan

    1 person found this answer helpful.

  2. Andy Cutler 1 Reputation point
    2020-05-30T15:09:53.677+00:00

    Ah OK thanks. So the SQL DML statements only work on Databricks at the moment.