Azure Synapse too slow to Open and work on Workspace
Hello- When loading and accessing Synapse workspace is taking a long time. Even it opens up after 20 mins - working around the workspace is very slow. There have been no changes/setting up. The health status looks fine. All env within that subscription…
No more allocated vCores on Azure For Students Subscription
Hello, I got an azure for students subscription a week ago and Azure Synapse Spark Pool worked just fine with the allocated 12 vCores that come with the subcription. I only used 2$ of credit as of now, but for some reason, since yesterday, new created…
Request Timeout on ADF Web Activity to Synapse
Hello everyone! I have a set of pipelines in Azure Data Factory (ADF) that trigger Synapse via a Web activity POST request. This setup worked until today around 11 AM CET, but now it’s throwing the following error: Error calling the endpoint. Response…
Permission Issues with Application Registration for Creating External Users in Azure Synapse Databases
Hello everyone, I’m encountering an issue with an Application Registration in Azure AD that needs to create external users in several on-demand Azure Synapse databases across multiple environments. Despite configuring the necessary permissions in Azure…
Retrieving schema of scanned assets(files in blob,sql tables) likee column names,datatypes from purview using synapse pyspark notebook.
Hi there, we are having a purview account,synapse with pyspakr, storage account. We are scanning the files in purview that are stored in storage, we are able to see the schema in purview for those files,now we are trying to retrieve the schema f for the…
How to share data from one synapse sql pool to another synapse sql pool in different subsciption
How to share data from one synapse sql pool to another synapse sql pool in different subsciption
When will Azure Data Explorer pool for Synapse become GA
When will Azure Data Explorer pool for Synapse become GA
Timeout error due to Error reading SSH protocol banner
Hi Team, We are facing ‘Timeout error due to Error reading SSH protocol banner’ while trying to connect to sftp server through Azure Synapse Notebook. We are using python as source language and paramiko version 2.12.0 to connect to the server and…
Permissions error in SSMS with a dataverse datalake
Hello, I'm having an issue with creating a PowerBI report - specifically connecting to a data source. I created a view in a datalake in SSMS based on dataverse data but keep experiencing this issue. My colleague cannot replicate the error and I'm not…
Unable to see the spark pool I have created while configuring the synapse link for dataverse
I have created a spark pool in my synapse workspace to use it for the delta conversion during configuring the synapse link for dataverse for the D365FO data , unfortunately once I choose the synapse workspace and enabled "Use spark pool for delta…
Error on Sink in ADLS Gen2 Data Load: 'Operation Failed Due to Remote Host Connection Reset' - How to Resolve?
Hello, we are experiencing the error below in some Pipelines, when running the trigger schedule the following error appears: Operation on target Load Programacao_Producao_full failed: Failure happened on 'Sink' side.…
Apache spark pool 3.3 deprecating but synapse link for dataverse is only supporting 3.3 version
I am trying to create a synapse link for dataverse for the D365FO data export , since the delta lake conversion is mandatory for F&O data I have tried creating a apache spark pool 3.4 version in synapse but it was not showing in the drop down while…
Missing Records in Azure Log Analytics
Hi All, Logs of activities, pipelines, and triggers are gathered within the Synapse environment for monitoring purposes. It has been observed that some pipelines ran successfully, as seen in the Monitor section of Synapse, but there are missing records…
How to fix 'Couldn't interpret '0000-07-01' as a valid DateTime' Error in copy activity - synapse analytics pipeline
Hello, Synapse analytics-copy data activity returning below error. But in my case many rows are having "0000-07-01" date in the DB table column. I have tried to change the datatype then to debug. But failed to copy. And then I tried copy…
Apache Spark 3.3 will retire but Azure Synapse Link use spark pool for delta conversion only support Apache Spark 3.3
Received email from MS mentioned that Apache Spark 3.3 will retire soon but Azure Synapse Link use spark pool for delta conversion only support Apache Spark 3.3 Any advises on this ?
How to save complete web activity output to ADLS Gen2 in JSON format? Azure Synapse Studio
I want to save the output of my Web activity (which hits an Api and then fetches data from that Api in Json format) into blob storage account container. Also, my web activity is within a foreach - so multiple Api links are being hit and multiple files…
Copy Dataverse data into Azure SQL using Synapse Link
Im using Azure Synapse pipeline to copy data from Dataverse to Azure SQL DB. For large tables, it is only copying 10 million records and it is not inserting after. I have about 15 mil records. I dont see any settings limitation anywhere on the pipeline.…
Event Trigger is not firing Synapse pipeline
I have created an Event Trigger in Synapse to trigger pipeline based on file arrival in a certain container. The trigger creation created the event subscription in my storage account and whenever I upload a file, I can see the events in the event…
Autoloader in Synapse
I want to load data incrementally using Azure Synapse Analytics Notebook(dedicated spark pool) there is an option on databricks to load data incrementally which is autoloader so my question was can we use this option in Azure Synapse Analytics…
Integration runtime is failing
Hi Team, we are unable to run the pipeline using Microsoft Integration Runtime and see following errors. |DEBUG: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown. at …