Process streaming data with Synapse Pipeline or Data Flow
Hi Team, May I know if I can use Synapse pipeline or Data Flow to connect Eventhub and process Streaming data? Pipeline: Data Flow: I try to use this visual programming to create a process to read streaming data from eventhub and join cosmos db etc.…
Want to move Synapse workspace
Hi everyone, I need to redeploy my Azure Synapse workspace but want to ensure that all of my dedicated SQL Pools remain intact and unaffected by the redeployment process. What steps should I follow to safely redeploy the workspace while retaining the SQL…
how to find specific value by using synapse
Hi, I am using Azure synapse analytics to read the source data from a gen2 container, and the source data is stored in parquet files. When using copy activity to load the data from parquet files to sql pool, it throw ParquetDateTimeExceedLimit error…
Facing error while posting data to api using web activity
Post is working fine in postman but getting below error in synapse web activity Error calling the endpoint. Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] An error occurred while sending the…
SAP CDC and SAP Tables connectors regarding SAP Note 3255746 ?
Dear Team, Is there any one who when through the SAP Note 3255746 ? What impact shroud we expect regarding the SAP CDC and SAP Tables connectors already implemented for our customers? Thanks for you input. Tarik
Synapse v/s Fabric
Hello Team, We have a requirement to build a DWH with existing structured data volumes of 5TB and would have to ingest 500GB of data on a daily basis. We are trying to figure out which one to choose between Microsoft Fabric and Azure Synapse Analytics.…
We have a requirement to export Oracle cloud fusion data to azure datalake at a monthly cadence. We are able to use rest connector, but getting error with Oracle service cloud connector
Synapse Oracle Service Cloud (Preview) Connector form synapse is giving following error when using hostname in following format <>.<>.ocs.oraclecloud.com as specified in documentation and get following error . ERROR [HY000]…
Connectivity issue with Azure Synapse Spark
I am having an issue when setting up packages in Spark pool within Azure Synapse. So when uploading requirements.txt or environment.yml files I am having issues in locating the libraries due to connectivity issue. Even when I run !pip install .. in Azure…
Issue with Synapse Linked Service and Storage Blob Data Contributor Role
Hi, I’m encountering an issue when trying to open the Synapse Linked Service that was automatically created by Azure Data Lake Storage. The error message I’m receiving is: “Please check permission on ... to make sure you have at least 'Storage Blob Data…
Azure SQL database restore to Synapse
we need to do restore sql server database from restore point to dedicated sql pool on synapse on same resource group we are trying to do restore azure sql server db on same restore group where we have synapse but it ends up with error ERROR1.JPG Command…
How to access non-master databases created in Synapse SQL Serverless environment
Hello world! I am new to Azure Synapse Pipelines. I have looked through the Q&A and attempted to find an answer using other resources, but haven't had success. I have created a database "myDB" within Azure Synapse SQL Serverless…
I'm getting an error saying 'No connection can be used' when trying to create Data Quality rules under a Data Product, even though I've already successfully connected to Azure Synapse
Hi everyone, I'm encountering an issue when trying to create Data Quality rules under a Data Product in Microsoft Purview. The error message I receive is: 'No connection can be used, try to create a connection first.' I've already established a…
Cant find in the metrics about the storage used in dedicated sql pool under Azure Synapse Analytics.
my account have been charged 0.68usd / day when adls gen2 shows me the storage uses 8.7 gb. it does not make sense. are there any way to monitor the exact storage used in Azure Synapse Analytics SQL Storage - Standard - AP Southeast in dedicated sql…
Synapse link cosmos db
Hi once container is enabled in cosmos db... How to check in synapse if it is working or not... Screenshot pls
Typo on Microsoft Learn Website
Hi Azure Support Team, Can you please check the typo on the below link & correct it: The word "phases" should be "phrases" "Extract key phases from a…
Facing issue while calling mssparkutils.notebook.runMuktiple([notebook_list along with parameters]) in azure synapse analytics
Here I try to call few notebooks in another common notebook. Where magic commands is not working to have control over the notebooks when it comes execute the required notebook. So I tried write through mssparkutils.notebook.runMultiple(), in this…
What are the differences between Dedicated SQL Pool in Synapse Analytics and a regular MS SQL database ?
I would like to know the differences in compute and storage between the two products - Dedicated SQL Pools in Synapse Analytics and Microsoft SQL Server RDBMS.
Use Unity Catalog OSS in Azure Synapse Spark (instead of Hive metastore)
Hi, some month ago, Databricks announced that they open sourced Unity Catalog. This is the GitHub project: https://github.com/unitycatalog/unitycatalog I was wondering if it is possible to use Unity Catalog in Azure Synapse Spark instead of Hive…
Build error SQL71657: Cannot create a multi-column distributed table
Did anyone able to solve the problem related to Build error SQL71657: Cannot create a multi-column distributed table in Azure DevOps?
calling another notebook with mssparkutils.notebook.run - Kernel doesn't exist
i am not able to execute a notebook with mssparkutils.notebook.run. However the magic command %run 'notebook' works. i am getting an error like this: com.microsoft.spark.notebook.msutils.NotebookExecutionException: Fetch notebook content for…