Serialization Exception after changing reading from attached ADLS account to the same ADLS Account but through a linked service.
Currently we are running a Synapse Notebook that reads from the "Primary ADLS Gen2 account" and parse data to JSON. This job has been running stable for a while now. We need to run the same logic but read from a different ADLS account instead,…
Permission Issues with Application Registration for Creating External Users in Azure Synapse Databases
Hello everyone, I’m encountering an issue with an Application Registration in Azure AD that needs to create external users in several on-demand Azure Synapse databases across multiple environments. Despite configuring the necessary permissions in Azure…
Adding a non AKV Linked Service does not modify the publish branch in Azure Synapse Analytics
I tried adding a non-AKV based linked service from a feature branch. As per MS Git troubleshoot doc for synapse, it should publish to the azure live synapse service directly, which it did, but it did not create a commit in the publish branch. The doc is…
trying to write data from adlsgen2 to synapse sql dedicated pool but getting data type error
I am trying to write data into a table from adls gen2 using a copy activity. when creating the table, i have to use varchar(max). varchar(8000) is not an option as my data is too big for that. when creating the table using dedicated sql pool, i am able…
Error on Sink in ADLS Gen2 Data Load: 'Operation Failed Due to Remote Host Connection Reset' - How to Resolve?
Hello, we are experiencing the error below in some Pipelines, when running the trigger schedule the following error appears: Operation on target Load Programacao_Producao_full failed: Failure happened on 'Sink' side.…
Unable to see the spark pool I have created while configuring the synapse link for dataverse
I have created a spark pool in my synapse workspace to use it for the delta conversion during configuring the synapse link for dataverse for the D365FO data , unfortunately once I choose the synapse workspace and enabled "Use spark pool for delta…
Partitioned parquet file into an Azure Database
I inserted a parquet file into an Azure database and it had low throughput so I thought if I partitioned the file I could load the partitions in parallel. I partitioned the file on DefaultRating using pyspark and tried to insert but I'm not getting the…
Unable to query deltalake file in Azure synapse
I have created a synapse link for dataverse for F&O data but when I tried query deltalake file it is throwing the error "Content of directory on path…
How to read zip file in Azure Synapse Notebook with extension of .zip.
Hi Team, Could you please advise the pyspark code, how to read zip files in synapse notebook. Example: File_Name - samplefile.zip Note: In the samplefile.zip we have multiple csv files, please let us know. The file Extension is only with .zip. …
How to connect to Function App(Azure Functions) from Azure Synapse Studio
I want to connect my function app through Synapse studio but cannot seem to figure out the configurations. Here is my function.json and function definition along with Synapse configurations. My synapse pipeline basically takes the output of the web…
Unable to delete Azure Synapse Workspace even through Powershell force deletion
Hello Team, I am unable to delete synapse analytics even though following up post through webUI or powershell. I tried following the steps mentioned in the link below :-…
Azure Synapse too slow to Open and work on Workspace
Hello- When loading and accessing Synapse workspace is taking a long time. Even it opens up after 20 mins - working around the workspace is very slow. There have been no changes/setting up. The health status looks fine. All env within that subscription…
Timeout error due to Error reading SSH protocol banner
Hi Team, We are facing ‘Timeout error due to Error reading SSH protocol banner’ while trying to connect to sftp server through Azure Synapse Notebook. We are using python as source language and paramiko version 2.12.0 to connect to the server and…
Parametrization for connection string is not working in linked service
Hi there, I have solution - data pipeline in Synapse taking data from mysql database. I need to parametrize it to be able run process across many environemnts (CI/CD). I set many linked services with code referencing on variable in yml file in style…
Permissions error in SSMS with a dataverse datalake
Hello, I'm having an issue with creating a PowerBI report - specifically connecting to a data source. I created a view in a datalake in SSMS based on dataverse data but keep experiencing this issue. My colleague cannot replicate the error and I'm not…
DeliveryFailedEvent from Azure Event Grid to Synapse trigger with errorCode=RequestEntityTooLarge
I have an event-driven flow where changes in Comsos DB triggers an Azure Function the Azure Function pushes each changed document to a topic in Azure Event Grid a Synapse trigger is triggered and pushes the changed document to a Synapse…
How to connect to on-prem Analysis server using synapse notebook and uses System assigned managed identity as authentication.
HI Team, I have an on-prem analysis server details like server name and data base name managed by another team, they have provided access to me on the server but now is it possible to use a synapse notebook to connect to on prem analysis svr. Using…
Identifying Unused Tables in AAS Cube Over the Last 30 Days
I have a question regarding identifying unused tables in Azure Analysis Services (AAS). In our organization, we’re using AAS, and due to limited storage, our cube refresh is failing. I’ve been tasked with finding a list of tables that haven’t been used…
No more allocated vCores on Azure For Students Subscription
Hello, I got an azure for students subscription a week ago and Azure Synapse Spark Pool worked just fine with the allocated 12 vCores that come with the subcription. I only used 2$ of credit as of now, but for some reason, since yesterday, new created…
How to send a mail notification for a failed pipeline in Azure Synapse Analytics?
How can I send a notification email to a specific email address without using a logic app when one of my Synapse Analytics pipelines fails? I would like to include the error message in the email notification.