Azure Synapse Analytics

Azure Synapse Analytics Workspace connector in power bi is not connecting, are there system issues? It was working fine yesterday.

I am unable to view data in power bi using the "azure synapse analytics workspace" connector, the navigator view just spins forever. IS there an issue with the service? It was working yesterday and there have been no changes to our…

Severe Slowdown of Synapse Workspace after Pipeline Run

The execution of my pipeline has caused a significant performance degradation within the Azure Synapse platform, resulting in prolonged response times and rendering the platform unusable in some instances.

Error when using pandas to write data to ADLS in Azure Synapse Analytics

Hi Mr/Mrs, I want to use pandas to write dataframe to .csv file into ADLS, but I got this issue although I put the access key, it didn't work. How can I fix this issue? Thanks!

How can we connect Blackboard DDA (a SaaS using PostgreSQL to store data ) via Azure Synapse analytics using SSL certificate for authentication in SHIR for Private Vnet enabled networks.

Blackboard DDA is a SaaS application which uses PostgreSQL as DB to store data. The DB uses a SSL certificate key to authenticate and we have private Vnet enabled. How to create a linked service for this DB and where do we store certificate in SHIR. Are…

Does synapse serverless sql pool OPENROWSET support "parquest based structured stream" format?

I can read from a data lake structured stream using synapse serverless sql pool OPENROWSET, by specifying FORMAT = 'SSTREAM'. Does OPENROWSET support "parquest based structured stream" format? If yes, then what value should I specify to FORMAT…

Linked services and Key Vault

Hello, Just a question regarding link services, basically, our orgnisation has linked services with one datasbases from different business area, now we need to ingest data from different source, ideally from sharepoint with all the csv files for other…

Cannot view data lake gen 2 containers using analytics synapse linked service view (even with the contributor permission granted)

Each time i try to view the contents of a data lake gen 2 container using the portal 'Data' tab. I get the following error; 'Storage Explorer Error Uncaught ReferenceError: O is not defined.' I have already given the resource and myself, the storage…

Synapse Spark v3.4 CREATE DATABASE testdb LOCATION '<>' Not working on Spark 3.4

Executing the following statement on Apache Spark runtime 3.4 results in an error. Tried to do this on different vanilla spark pool configurations on different tennants in West Europe. database_name = 'test_sppool34' target_location =…

In ADF, I am not able to merge data from multiple streams with different columns with different data types

Hello, I am not able to merge data from multiple streams in ADF DATAFLOWS. Stream 1) flow let - only 1 column. Stream 2) flow let - only 1 column. Stream 3) source columns (54 columns) Stream 4) regular…

error when module is publish in power bi

I am getting this error when module is publish in power bi Data source credentials missing The data source sandpit is missing credentials. Ask the dataset owner to update the credentials.

Error when I use synapse serverless sql pool OPENROWSET to read from a data lake structured stream with similar column name but only different casing

How to prevent eventual "An insufficient number of arguments were supplied for the procedure or function cdc.fn_cdc_get_net_changes_" in Synapse?

I have a Data Flow that takes various tables from an Azure SQL Database source. All of these tables have CDC enabled at the Database level as well as having CDC enabled on the Source Connector (set to "Full on the first run, then…

How to improve the apache pool efficiency ?

I have roughly around 3000 jsons and i am creating a dataframe out of it and saving it to delta format and it is taking me hours for that even though my spark pool is of medium size. The spark pool runs at 33% utilization,

File cannot be opened because it does not exist or it is used by another process in Azure Synapse workspace

Hi, I created a new Azure Synapse Analytics resource and uploaded some csv files to the data lake storage created with the Synapse. I can see the files in the workspace and preview the files. However, when I tried to create a new SQL script from the…

Automatic updates on source systems

Hi friends, I have a requirement that the business has 12 different upstream sources SAP, CRM, Oracle HCM, SqlServer, PostgreSQL, and multiple other open-source databases and custom applications, etc. and every system has its master record, and just…

How to get notified when synapse integration runtime status is not in running state

Hello, I'm working on setting up a notification system in Azure Synapse Analytics to alert me when my self-hosted Integration Runtime (IR) is not in a 'running' state. My plan is to create a pipeline that retrieves the IR status through a REST API and…

Pass value from an array selectively to For Each

Hi, I have a parent pipeline that captures values in an array - ArrayFullLoadData. Currently ArrayFullLoadData have three values [A,B,C] and the same is passed to a ForEach with @pipeline.parameters.ArrayFullLoadData. Inside ForEach, values A, B,C are…

Azure Synapse Error

Hi everyone! I used Metada Driven toll from Azure Synapse Analytics in order to build my pipeline. It works perfectly fine, but onse in while I am getting this error msg. { "errorCode": "2200", "message":…

Synapse workspace deployment node-js supported versions

Hi, I would like to know the list of node.js versions supported for Synapse workspace deployment (Synapse Workspace Deployment@2 task). I can't seem to find any documentation describing the same.

Azure Synapse Analytics Workspace And its Dedicated SQL Pool Migration From one subscription to another subscription during Cross Subscription Migration

I just Want to know that how can I migrate synapse workspace and its dedicated SQL pool from one subscription to another subscription during cross subscription migration