Parametrization for connection string is not working in linked service
Hi there, I have solution - data pipeline in Synapse taking data from mysql database. I need to parametrize it to be able run process across many environemnts (CI/CD). I set many linked services with code referencing on variable in yml file in style…
Getting error "Login failed for user '
I have a resource group under which I have created a sql pool and Synapse workspace. Whenever I am running a query like "CREATE SCHEMA foodmart" it is giving the following error. "Login failed for user '
In my ADF I have few pipelines, is it possible to Export / Migrate those pipelines in Synapse Analytics...?
In ADF I have grouped all the activities in the form of Pipelines, So is it possible to migrate or export those pipelines in Azure Synapse.
Need to automate a Synapse Analytics Pipeline to gather the information from the previous day. every day
I have a Synapse Analytics Pipeline that gather information from SharePoint and put it into a storage account container in Azure. It is a Copy data action. Right now, every time I need to get more data, I need to change the date on Source /Date filter…
How to save complete web activity output to ADLS Gen2 in JSON format? Azure Synapse Studio
I want to save the output of my Web activity (which hits an Api and then fetches data from that Api in Json format) into blob storage account container. Also, my web activity is within a foreach - so multiple Api links are being hit and multiple files…
How can I write to a Dataverse lookup using an alternate key?
Hi I want to write data to Dataverse via a Synapse Copy Data task in a pipeline. The destination tables all have alternate keys set up. So for example, I could have a Country entity, with CountryAlternateKey (e.g. ISO code) and Name, and a City with…
Identifying Unused Tables in AAS Cube Over the Last 30 Days
I have a question regarding identifying unused tables in Azure Analysis Services (AAS). In our organization, we’re using AAS, and due to limited storage, our cube refresh is failing. I’ve been tasked with finding a list of tables that haven’t been used…
Dataflow debug only shows 100 rows even if the query returns >100 records. Row limit is set to 1000.
Dataflow debug only shows 100 rows in the web UI in tabular format even if the query returns >100 records. Row limit is set to 1000. Is this the default behavior in azure synapse analytics? I know this is a display only behavior as I am able to join…
How to add expression on result of aggregate function when create Materialized View in Synapse
Hi there, When I creating materialized view in synapse, i got an error, it says "because the select list of the view contains an expression on result of aggregate function or grouping column. Consider removing expression on result of aggregate…
D365 F&O synchronisation table dans spark (GEN 2) , comment modifier la structure de la table
Bonjour pour des besoins d'interfaces nous avons mis en place la réplication de certaines table de D365 F&O par le biais de la power plateforme (GEN 2) qui a créé un pool Spark dans synapse mais j'ai un champs de table qui ne récupère pas la bonne…
Insufficient System Memory in Synapse Analytics Pipeline
Encountering issues with a Synapse Analytics Pool where the pipeline run fails with the error message: "Operation on target GetLastChangedFeedFiles failed: There is insufficient system memory in resource pool 'VDWFrontendPool' to run this…
Timeout error due to Error reading SSH protocol banner
Hi Team, We are facing ‘Timeout error due to Error reading SSH protocol banner’ while trying to connect to sftp server through Azure Synapse Notebook. We are using python as source language and paramiko version 2.12.0 to connect to the server and…
Retrieving schema of purview scanned assets with object type is file also,i want to retrieve the schema of assets scanned with Cosmos db as source
I could get the schema for Object type is Tables in purview, but i couldn't retrieve for the object type is files,when I am calling atlas API the schema i get is empty[].
Adding a non AKV Linked Service does not modify the publish branch in Azure Synapse Analytics
I tried adding a non-AKV based linked service from a feature branch. As per MS Git troubleshoot doc for synapse, it should publish to the azure live synapse service directly, which it did, but it did not create a commit in the publish branch. The doc is…
Web activity is throwing an error in adf pipeline
One of the web activities in my adf pipeline is throwing an error : Error calling the endpoint 'https://acp-01-appkv.vault.azure.net'. Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] The remote…
Unable to delete Azure Synapse Workspace even through Powershell force deletion
Hello Team, I am unable to delete synapse analytics even though following up post through webUI or powershell. I tried following the steps mentioned in the link below :-…
Serialization Exception after changing reading from attached ADLS account to the same ADLS Account but through a linked service.
Currently we are running a Synapse Notebook that reads from the "Primary ADLS Gen2 account" and parse data to JSON. This job has been running stable for a while now. We need to run the same logic but read from a different ADLS account instead,…
RBAC permissions for debugging synapse data flow
Hi All. I am getting the error below when trying to debug a pipeline within Azure synapse You do not have required Synapse RBAC permission to perform this action. Contact a Synapse Administrator for this workspace. Required permission: Actions:…
How to connect to on-prem Analysis server using synapse notebook and uses System assigned managed identity as authentication.
HI Team, I have an on-prem analysis server details like server name and data base name managed by another team, they have provided access to me on the server but now is it possible to use a synapse notebook to connect to on prem analysis svr. Using…
Automate the activation of required tables in the Synapse Link for dataverse
Hi All, I am using Synapse Link for Dataverse for loading data from Dynamics 365 to ADLS. I have to manually activate the required tables in the Synapse link inside the dataverse, which is a pain point every time. Q1. Is there a way to automate this…