Question on Parallelism in Azure Synapse Analytics
Hello experts, I'm seeking clarification on the concept of parallelism in Azure Synapse Analytics. Specifically, I'd like to understand how parallel processing is utilized within Synapse Analytics to optimize query performance and data processing. Can…
Access Azure SQL DBs using Azure Synapse studio
I would like to understand how Azure Synapse Analytics can be used within the organization to facilitate data analysis and development. How will developers access Azure Datasets in a convenient way Is there a case for using Azure Synapse? I have a use…
rename of pipeline failed part-way, now I have both source and destination pipeline and cant remove them
Hi we have a pipeline A that was being renamed to pipeline B, and the rename has failed. now we have pipeline A with an EntityState of "Deleting", and Pipeline B with an EntityState of "Creating". they are linked by Source and Target…
Joining different SQL pools under one workspace in synapse
Hello, are we able to join two different SQL pools under one workspace which allows me to join tables as a query under Synapse/Datafactory? Many thanks
Is it possible to run Azure Synapse Pipelines with user impersonation?
We would like to run analysis scripts (Azure synapse pipeline) on user defined data (Azure storage), but we don't want to bother to get access to every possible storage account on our end. For this it would be beneficial to just use user impersonation…
Trouble Connecting Synapse Endpoint to Power BI After Latest Update
Hi, everyone! I have a connection between Synapse and pbix. Before the last update of Power BI in March 2024, I could connect easily using the SQL Server connector, and I set Database Credentials, Unencrypted Connection, Privacy Level = None. But after…
CosmosDB Analytical store delete changes in sql sink
Hi I am trying to capture delete changes from Azure cosmosdb analytical store using change data capture in Azure datafactory, Source is Cosmosdb, sink is Azure sql database. In between I am flattening my file using dataflow. My insert, update is…
Help on executing custom query on Azure Cosmos DB using Spark in Azure Synapse
Hi Team, I want to run custom query against cosmos db in spark using clientid and secret but I'm ending up with below error. can you please assit. I tried multiple way but it still gives same error. AppId has Reader access on the cosmos db account. As…
How to connect ADLS Gen2 from Synapse Notebook, using SAS Token.
Hello, i'm trying to connect with Data Lake Storage Gen2 in Synapse Notebook. I'm trying to send a parquet file from my subscription's ADLS to other subscription's ADLS. So i got a SAS token from other subscription's ADLS, and I tried to connect ADLS…
Using elephas and keras deep learning libraries in Synapse notebook
Hi, I tried to find a solution for distributed computing with Keras deep learning libraries in Azure Synapse Notebook. 'elephas' looks like a good option. But I encountered the following error: Py4JJavaError Traceback (most recent call last) Cell In…
Workspace is in non-terminal state Failed and cannot be updated
Hello, I was working on creating a new workspace in Azure Synapse Analytics. During deployment, error is encountered. I tried to delete and re-create the workspace but same error. Tried to re-deploy, still error persisted. Any advice? Workspace is in…
How to identify if someone has disconnected AzureGit in Azure Synapse Analytics
Someone has disconnected the AzureGit connection from Azure Synapse Analytics. Is there a way to figure out who has done that task or is there a way to restrict it ? or is there any way we can implement security so only selected people can…
I cannot access synapse workspace in Azure. error code
Failed to load Failed to load role assignments due to forbidden issue, error code 403. Refresh or troubleshoot the issue. Please can someone help. I am the owner of the subscription.
How can I scan views from the same Azure Synapse Analytics schema to multiple collections?
I have multiple collections in Microsoft Purview. I have registered an Azure Synapse Analytics source to a parent collection. Depending on the ownership of the datasets I need to scan in views from the same schema to different collections. When I scan…
Azure Synapse Analytics Workspace connector in power bi is not connecting, are there system issues? It was working fine yesterday.
I am unable to view data in power bi using the "azure synapse analytics workspace" connector, the navigator view just spins forever. IS there an issue with the service? It was working yesterday and there have been no changes to our…
Location 'southindia' is not accepting creation of new Windows Azure SQL Database servers for the subscription
I tried creating an Azure Synapse workspace. After clicking on the final 'review+create' option & it was getting deployed, I received an error (image below). However, I can see a storage account & a synapse storage account created. Only the…
Severe Slowdown of Synapse Workspace after Pipeline Run
The execution of my pipeline has caused a significant performance degradation within the Azure Synapse platform, resulting in prolonged response times and rendering the platform unusable in some instances.
ADLS Gen2 operation failed: Operation returned an invalid status code Conflict. Account: 'x' endpoint does not support BlobStorageEvents or SoftDelete
Currently setting up a storage account for a synapse analytics workspace, there is an existing synapse workspace with a linked service to an azure storage account, When I tried to setup a similar configuration I get the error message below. Here it…
Error trying to validate storage account name while creating a new synapse workspace
I am unable to create a new data lake storage (gen2) account name in the basic tab for create Azure Synapse Workspace. The error I get is - " There was an error trying to validate storage account name. please try again ". The error message is…
How to query Kusto data in Synapse with cert auth in linked service
Hi, I'm trying to query Kusto data with linked service in Synapse. Synapse can generate the samples automatically as below. It can work when I use secret of application in setting up linked service. But it failed with the error when I tried to use cert…