Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Found duplicate data in the table <tableName>. Source type: <sourceName>.
IDENTICAL_ROWS
Found <count> identical row(s): <rowExample>.
Please remove the duplicate rows from the source and run the pipeline again. If the error still persists, then file a ticket.
ROWS_WITH_SAME_PRIMARY_KEY
Primary key(s) <keys> contain duplicates. Found <count> rows for key <keyExample>.
You can either remove the duplicate from the data source or set the field "primary_keys": ["__databricks_id"] in the table_configuration with SCD TYPE 1 and full refresh the impacted table; this creates a hash of all selected columns in the source to enable ingesting the duplicate key.