Cosmos Synapse link SQL query error
Hi, we have a Synapse SQL View onto a Cosmos container (using Synapse link). When we run a SELECT * on the view we sometimes get this error: Resolving CosmosDB path has failed with error 'CosmosDB request failed with status code '449';…
reduce waiting time within a synapse pipeline/ improve performance synapse pipeline
A certain synapse pipeline takes a very long time. When I look at the various activities within this pipeline, the activities themselves don't take much time at all. It's mostly the waiting time between them that is consuming a lot of time. We are using…
Stored Procedure Activity getting failed
Hi, I have got to use couple of external tables(parquet) in dedicated sql pool. when I run stored procedures in dedicated sql pool using those external tables, its running successfully. But when I started running stored procedure using stored procedure…
SAP CDC and SAP Tables connectors regarding SAP Note 3255746 ?
Dear Team, Is there any one who when through the SAP Note 3255746 ? What impact shroud we expect regarding the SAP CDC and SAP Tables connectors already implemented for our customers? Thanks for you input. Tarik
Single Pyspark notebook to call multiple notebooks through parameters
I have one pyspark notebook1 which loads one ERP system (ex:A ) , another notebook loads one more ERP system ( ex: B) . I want to create another notebook to call above 2 notebooks through parameters .. the notebook should ask parameter to enter ERP …
Insufficient memory when running script/stored procedure activity using synapse
So serverless sql have a limit memory of data processed? I got the error message like this: Operation on target Stored procedure1 failed: Execution fail against sql server. Please contact SQL Server team if you need further support. Sql error number:…
Get Metadata synapse activity returns wrong data type from parquet file
When the synapse pipeline creates external table we need data types, so currently we're using Get Metadata synapse activity that returns the columns types from the parquet file of the corresponding table. For the couple of tables the data type…
LivyHttpRequestFailure: Something went wrong while processing your request. Please try again later. HTTP status code: 500. Trace ID: d2425fce-9179-49eb-829c-a7b2a0d963ed.
Hi Everyone, I am getting the Below Error Code while running my cells in Synapse Notebook: > LivyHttpRequestFailure: Something went wrong while processing your request. Please try again later. HTTP status code: 500. Trace ID:…
Cannot edit an existing data factory in synapse
I have a synapse workspace with several pipelines with data factories. Today I have noticed that existing data factories that are running correctly I cannot see the details when I edit them I attach two examples, one that is working and the other that I…
How to use IS NOT NULL in synapse dataflow
I would like to use IS NOT NULL in synapse's dataflow, but I can't get it to work. Can you please tell me how to do it? I have also tried notNull, but it doesn't work... I used the dataflow filter.
Writing binary data to ADLS in Synapse notebook
Hi all, Is it possible to write binary data to the ADLS in Synapse notebook using Pyspark? I retrieve data via an API call where the content type is application/excel (basically binary data) and want to save it to the ADLS, a specific location like…
Access Azure SQL DBs using Azure Synapse studio
I would like to understand how Azure Synapse Analytics can be used within the organization to facilitate data analysis and development. How will developers access Azure Datasets in a convenient way Is there a case for using Azure Synapse? I have a use…
Synapse spark V3.4 bug??
I am unable to create a database using Spark 3.4. Is there any existing issue with spark 3.4?
How to translate database content with Azure Translator by ADF or Synapse notebook?
There is an Azure Database table. Some of columns need to be translated from one language to another into additional columns. Such as from English to Spanish, or Portuguese to English, etc. I am exploring how I can use ADF or Synapse notebook to…
Utilizing Azure Key Vault secrets for secure password management in Apache spark connector for SQL Server
In the provided code example, our team demonstrates using a hard-coded username and password for connecting to SQL Server using the Apache Spark connector. However, for enhanced security, I want to utilize a password stored in Azure Key Vault instead of…
Configuring Alert Rules to Not Send Secondary Resolved Notification
We have set up an alert rule to notify us when a pipeline has failed in our synapse works (when pipeline failure > 0). The evaluation is based on a period of 5 minutes with a frequency of evaluation every 1 minute. The set up works well in notifying…
How can I scan views from the same Azure Synapse Analytics schema to multiple collections?
I have multiple collections in Microsoft Purview. I have registered an Azure Synapse Analytics source to a parent collection. Depending on the ownership of the datasets I need to scan in views from the same schema to different collections. When I scan…
How to use Localhost (On-premise database) as sink in Azure Data Factory? It's possible to have source as On-premise database but why not as "Sink"?
I want to use my local database on-premise as "SINK" in Azure Data Factory. It's possible to have it as a "Source" using self-hosted-integration-runtime but why not as a "SINK"???
Azure Synapse Serverless SQL backup/recovery
We use Azure Synapse Workspaces, with Serverless SQL pools. How would one implement a disaster recovery solution to support this (across Azure regions, with geo-replicated StorageV2 (general purpose v2) datalake storage accounts.)? The automated…
hii want to run stored procedure in synapse but ima getting an error ,can anyone help me
query: USE gold_db GO CREATE OR ALTER PROC CreateSQLServerlessView_gold @ViewName nvarchar(100) AS BEGIN DECLARE @statement VARCHAR(MAX) SET @statement = N'CREATE OR ALTER VIEW '+@ViewName+' AS SELECT * FROM OPENROWSET(BULK…