Reading data from Synapse Lake Database (Azure Synapse Link for Dataverse)

Esser, Lukas (ADM) 16 Reputation points
2022-03-18T13:39:17.88+00:00

Hi guys,

we have the following setup:

A "SELECT TOP 100" statement always works. But I have an issue when I set up serious queries: in 8 out of 10 cases it throws an error: Cannot bulk load because the file "https://p.../opportunity/2022-03.csv" could not be opened. Operating system error code 12(The access code is invalid.).
As far as I read this is because there are changes written to that file while I am quering it. I have read about the ALLOW_INCONSISTENT_READS option here, but I have no idea where so set this up, as the lake database was autogenerated when configuring the synapse link.

How should one query the data in the lake database to avoid this error? I can't build applications on top of that data if 8 out of 10 queries fail. Any help would be greatly appreciated!

When it's working: pCL6YAd
When not: B0x2ZSd

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,484 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Anon101 51 Reputation points
    2022-11-24T15:36:29.007+00:00

    If this has been established as a bug then may I ask when the fix will be rolled out, rather than work around the issue but querying partitioned tables? Thanks.

    0 comments No comments