Error encountered while parsing data: 'Quotes '\"' must be inside quoted field errorCode": "2200",

Peter Webb 0 Reputation points
2024-02-01T12:44:44.0033333+00:00

CopyData is failing with "Error encountered while parsing data: 'Quotes '"' must be inside quoted field byte at [byte: 5]. '. Underlying data description: file 'Tables/Custom/HCMWORKER/index.json" The function works on many other blob storage files with the same structure. These files are automatically created from a Dynamics 365 Lake export. The data is in a serverless pool in synapse and can be retrieved when running a select.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,108 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Harishga 1,990 Reputation points Microsoft Vendor
    2024-02-02T10:51:34.9666667+00:00

    Hi @Peter Webb

    Welcome to Microsoft Q&A platform and thanks for posting your question here.

    The error message "Error encountered while parsing data: 'Quotes '"' must be inside quoted field byte at [byte: 5]" indicates that there is an issue with the formatting of the data in the file 'Tables/Custom/HCMWORKER/index.json'. Specifically, there is a quote character that is not properly enclosed within quotes.

    This error can occur when the data in the file is not formatted correctly, or when there is an issue with the encoding of the file. To resolve this issue, you can try the following steps:

    • Check the data file that is causing the error. Look for any issues with the formatting of the data, such as missing or extra quotes.
    • If you find any issues with the formatting of the data, correct them and try running the CopyData activity again.
    • If you are still encountering the error, you can try using the "preserve" option in the copy activity. This option will preserve the formatting of the data during the copy operation, which may help to avoid issues with the formatting.

    Reference
    https://stackoverflow.com/questions/70449291/azure-synapse-serverless-sql-pool-error-while-selecting-from-quoted-fields

    I hope this information helps you. Let me know if you have any further questions or concerns.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    1 person found this answer helpful.