If this has been established as a bug then may I ask when the fix will be rolled out, rather than work around the issue but querying partitioned tables? Thanks.
Reading data from Synapse Lake Database (Azure Synapse Link for Dataverse)
Hi guys,
we have the following setup:
- Our CRM system exports its data via Azure Synapse Link for Dataverse (https://learn.microsoft.com/en-us/powerapps/maker/data-platform/export-to-data-lake)
- This creates a "lake database" in our Synapse workspace
A "SELECT TOP 100" statement always works. But I have an issue when I set up serious queries: in 8 out of 10 cases it throws an error: Cannot bulk load because the file "https://p.../opportunity/2022-03.csv" could not be opened. Operating system error code 12(The access code is invalid.).
As far as I read this is because there are changes written to that file while I am quering it. I have read about the ALLOW_INCONSISTENT_READS
option here, but I have no idea where so set this up, as the lake database was autogenerated when configuring the synapse link.
How should one query the data in the lake database to avoid this error? I can't build applications on top of that data if 8 out of 10 queries fail. Any help would be greatly appreciated!