Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,295 questions
Synapse Pipeline started failing today
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 10%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMT%3C/text%3E%3C/svg%3E)
Mahesh Totageri
21
Reputation points
Hi Team,
Till today Synapse pipeline was running successful, but from today morning it started failing with below error.
we did't have any changes to the code, could you please help me to understand more why it is failing.
{
"errorCode": "2011",
"message": "COPY statement input file schema discovery failed: Incorrect syntax near 'BULK'.\r\n--Metadata prep--\r\nReplaceViewSyntax.json error",
"failureType": "UserError",
"target": "CreateSynapseTable",
"details": []
}
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT 46,627 Reputation points Microsoft Employee2023-08-11T19:29:52.0266667+00:00 @Mahesh Totageri Welcome to Microsoft Q&A forum and thanks for reaching out here.
Since you have mentioned that the pipeline used to run without issues until today and all of sudden it started failing without any change in your pipeline code.
Since you confirmed there is no change in your pipeline code, could you please confirm if you have got a chance to check the source files format, file type and the schema of the file for which the pipeline runs are failing? If there is no change on the pipeline side and as it used to work without issue earlier, then I suspect something wrong with the source files which you are referring to in your COPY statement. Could you please validate them?
Can try with old files that were processed earlier and see if they are also resulting in same issue? (Please try it in a lower environment)
-
Mahesh Totageri 21 Reputation points
2023-08-13T16:26:55.58+00:00 Again it stated running today morning, without any changes.
not sure may be any prod update cause this issue.
Thanks,
Mahesh
-
KranthiPakala-MSFT 46,627 Reputation points Microsoft Employee
2023-08-14T01:11:30.8566667+00:00 @Mahesh Totageri Glad to know it's processing now.
Could you please confirm if the data files are same or different between the failed one and the successful run?
If they are different data files, then I suspect it could be because if the file format or incorrect source data. I would recommend comparing the failed data with the successful data to see what went wrong and take action accordingly to avoid such failures in future.
Please let us know your observation based on comparison between the two data files.
-
Mahesh Totageri 21 Reputation points
2023-08-14T13:51:27.3166667+00:00 Hello @KranthiPakala-MSFT
Thanks for you response!!!
we are getting CSV files and there no changes on that, it was running with same file and suddenly it started failing with same file and again it is running success with same file format.
Still not getting what is caused this issue.
If possible could you please get me the cause what had happened in the backend, if you need will share the Activity Id for failures.
Thanks,
Mahesh
-
KranthiPakala-MSFT 46,627 Reputation points Microsoft Employee
2023-08-15T01:02:39.1566667+00:00 @Mahesh Totageri I would suggested to file a support ticket for deeper investigation of this issue. The support engineer may ask for more information about the failure pipeline so that they can dig deeper and provide the root cause and possible solutions to avoid them in future.
Please do share the support ticket number once it is filed so that we can track it internally. In case if you don't have a support plan, let me know here.
Thank you
Sign in to comment
Sign in to answer