4,935 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

Process streaming data with Synapse Pipeline or Data Flow

Hi Team, May I know if I can use Synapse pipeline or Data Flow to connect Eventhub and process Streaming data? Pipeline: Data Flow: I try to use this visual programming to create a process to read streaming data from eventhub and join cosmos db etc.…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
643 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-18T13:18:52.67+00:00
Jia Zhang 40 Reputation points
answered 2024-10-18T21:31:41.99+00:00
Amira Bedhiafi 25,261 Reputation points
1 answer

Want to move Synapse workspace

Hi everyone, I need to redeploy my Azure Synapse workspace but want to ensure that all of my dedicated SQL Pools remain intact and unaffected by the redeployment process. What steps should I follow to safely redeploy the workspace while retaining the SQL…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-18T17:02:30.6633333+00:00
AinoKaisa 20 Reputation points
answered 2024-10-18T21:28:50.2633333+00:00
Amira Bedhiafi 25,261 Reputation points
1 answer

how to find specific value by using synapse

Hi, I am using Azure synapse analytics to read the source data from a gen2 container, and the source data is stored in parquet files. When using copy activity to load the data from parquet files to sql pool, it throw ParquetDateTimeExceedLimit error…

Azure
Azure
A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.
1,031 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-18T18:57:05.99+00:00
Zhu, Yueli YZ [NC] 235 Reputation points
answered 2024-10-18T21:24:26.33+00:00
Amira Bedhiafi 25,261 Reputation points
1 answer

Facing error while posting data to api using web activity

Post is working fine in postman but getting below error in synapse web activity Error calling the endpoint. Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] An error occurred while sending the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,740 questions
asked 2023-04-12T15:24:31.5333333+00:00
Lakshmi Niharika Paladugu 15 Reputation points
commented 2024-10-18T19:30:43.2633333+00:00
Patel, Siddhartha 0 Reputation points
6 answers

SAP CDC and SAP Tables connectors regarding SAP Note 3255746 ?

Dear Team, Is there any one who when through the SAP Note 3255746 ? What impact shroud we expect regarding the SAP CDC and SAP Tables connectors already implemented for our customers? Thanks for you input. Tarik

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,740 questions
asked 2024-04-23T11:45:42.5766667+00:00
Tarik Zaaboul 5 Reputation points
commented 2024-10-18T15:11:01.93+00:00
Christopher Grancher 0 Reputation points
1 answer One of the answers was accepted by the question author.

Synapse v/s Fabric

Hello Team, We have a requirement to build a DWH with existing structured data volumes of 5TB and would have to ingest 500GB of data on a daily basis. We are trying to figure out which one to choose between Microsoft Fabric and Azure Synapse Analytics.…

Azure Service Fabric
Azure Service Fabric
An Azure service that is used to develop microservices and orchestrate containers on Windows and Linux.
268 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-17T08:21:25.8633333+00:00
Nagesh CL 666 Reputation points
commented 2024-10-18T14:23:10.3433333+00:00
Nagesh CL 666 Reputation points
2 answers

We have a requirement to export Oracle cloud fusion data to azure datalake at a monthly cadence. We are able to use rest connector, but getting error with Oracle service cloud connector

Synapse Oracle Service Cloud  (Preview) Connector form synapse is giving following error when using hostname in following format <>.<>.ocs.oraclecloud.com as specified in documentation and get following error . ERROR [HY000]…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-02T01:54:22.8166667+00:00
Dataarch_MM 0 Reputation points
commented 2024-10-18T14:00:30.0966667+00:00
Dataarch_MM 0 Reputation points
0 answers

Connectivity issue with Azure Synapse Spark

I am having an issue when setting up packages in Spark pool within Azure Synapse. So when uploading requirements.txt or environment.yml files I am having issues in locating the libraries due to connectivity issue. Even when I run !pip install .. in Azure…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-16T07:04:44.95+00:00
NCLO_AZU_a_T6805I0 0 Reputation points
commented 2024-10-18T06:04:53.65+00:00
Smaran Thoomu 16,230 Reputation points Microsoft Vendor
0 answers

Issue with Synapse Linked Service and Storage Blob Data Contributor Role

Hi, I’m encountering an issue when trying to open the Synapse Linked Service that was automatically created by Azure Data Lake Storage. The error message I’m receiving is: “Please check permission on ... to make sure you have at least 'Storage Blob Data…

Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
3,183 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,876 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-17T06:47:53.26+00:00
Nguyen Luong 0 Reputation points
edited a comment 2024-10-18T05:44:14.4366667+00:00
Nguyen Luong 0 Reputation points
2 answers

Azure SQL database restore to Synapse

we need to do restore sql server database from restore point to dedicated sql pool on synapse on same resource group we are trying to do restore azure sql server db on same restore group where we have synapse but it ends up with error ERROR1.JPG Command…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
13,866 questions
asked 2024-09-11T14:01:57.8966667+00:00
Andrea Galardi 0 Reputation points
answered 2024-10-17T14:52:09.0066667+00:00
Julian Francis 0 Reputation points
1 answer One of the answers was accepted by the question author.

How to access non-master databases created in Synapse SQL Serverless environment

Hello world! I am new to Azure Synapse Pipelines. I have looked through the Q&A and attempted to find an answer using other resources, but haven't had success. I have created a database "myDB" within Azure Synapse SQL Serverless…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-16T00:10:18.35+00:00
Sam Affolter 20 Reputation points
commented 2024-10-16T16:27:35.73+00:00
Sam Affolter 20 Reputation points
1 answer

I'm getting an error saying 'No connection can be used' when trying to create Data Quality rules under a Data Product, even though I've already successfully connected to Azure Synapse

Hi everyone, I'm encountering an issue when trying to create Data Quality rules under a Data Product in Microsoft Purview. The error message I receive is: 'No connection can be used, try to create a connection first.' I've already established a…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
Microsoft Purview
Microsoft Purview
A Microsoft data governance service that helps manage and govern on-premises, multicloud, and software-as-a-service data. Previously known as Azure Purview.
1,194 questions
asked 2024-10-15T15:25:53.06+00:00
USer22222 0 Reputation points
commented 2024-10-16T13:37:59.59+00:00
PRADEEPCHEEKATLA-MSFT 89,816 Reputation points Microsoft Employee
1 answer

Cant find in the metrics about the storage used in dedicated sql pool under Azure Synapse Analytics.

my account have been charged 0.68usd / day when adls gen2 shows me the storage uses 8.7 gb. it does not make sense. are there any way to monitor the exact storage used in Azure Synapse Analytics SQL Storage - Standard - AP Southeast in dedicated sql…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-14T03:55:16.1433333+00:00
Eddy Au Yeung 0 Reputation points
commented 2024-10-16T11:56:48.39+00:00
PRADEEPCHEEKATLA-MSFT 89,816 Reputation points Microsoft Employee
1 answer

Synapse link cosmos db

Hi once container is enabled in cosmos db... How to check in synapse if it is working or not... Screenshot pls

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-14T03:30:33.12+00:00
Vineet S 950 Reputation points
commented 2024-10-16T11:56:03.67+00:00
PRADEEPCHEEKATLA-MSFT 89,816 Reputation points Microsoft Employee
1 answer

Typo on Microsoft Learn Website

Hi Azure Support Team, Can you please check the typo on the below link & correct it: The word "phases" should be "phrases" "Extract key phases from a…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-13T02:48:03.1066667+00:00
SANJAY GUPTA 0 Reputation points
commented 2024-10-16T11:53:07.82+00:00
PRADEEPCHEEKATLA-MSFT 89,816 Reputation points Microsoft Employee
1 answer

Facing issue while calling mssparkutils.notebook.runMuktiple([notebook_list along with parameters]) in azure synapse analytics

Here I try to call few notebooks in another common notebook. Where magic commands is not working to have control over the notebooks when it comes execute the required notebook. So I tried write through mssparkutils.notebook.runMultiple(), in this…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-10T06:48:34.6166667+00:00
karthik raja 0 Reputation points
commented 2024-10-16T11:49:15.8066667+00:00
PRADEEPCHEEKATLA-MSFT 89,816 Reputation points Microsoft Employee
2 answers One of the answers was accepted by the question author.

What are the differences between Dedicated SQL Pool in Synapse Analytics and a regular MS SQL database ?

I would like to know the differences in compute and storage between the two products - Dedicated SQL Pools in Synapse Analytics and Microsoft SQL Server RDBMS.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-09-30T05:12:00.6133333+00:00
Anil Saraswathy 20 Reputation points
commented 2024-10-16T10:43:06.0033333+00:00
Ashok Damodaran 6 Reputation points
1 answer

Use Unity Catalog OSS in Azure Synapse Spark (instead of Hive metastore)

Hi, some month ago, Databricks announced that they open sourced Unity Catalog. This is the GitHub project: https://github.com/unitycatalog/unitycatalog I was wondering if it is possible to use Unity Catalog in Azure Synapse Spark instead of Hive…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-11T15:49:36.6033333+00:00
Martin B 101 Reputation points
commented 2024-10-15T18:47:51.2566667+00:00
Hans Geurtsen 1 Reputation point
1 answer

Build error SQL71657: Cannot create a multi-column distributed table

Did anyone able to solve the problem related to Build error SQL71657: Cannot create a multi-column distributed table in Azure DevOps?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2024-10-12T17:39:11.82+00:00
Sameer Kanchi 11 Reputation points
commented 2024-10-15T17:57:09.2833333+00:00
PeterFredericks-Love-4248 1 Reputation point
2 answers One of the answers was accepted by the question author.

calling another notebook with mssparkutils.notebook.run - Kernel doesn't exist

i am not able to execute a notebook with mssparkutils.notebook.run. However the magic command %run 'notebook' works. i am getting an error like this: com.microsoft.spark.notebook.msutils.NotebookExecutionException: Fetch notebook content for…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,935 questions
asked 2023-03-15T07:46:42.0666667+00:00
Garon Fabienne 20 Reputation points
edited an answer 2024-10-15T14:48:05.18+00:00
NPizzuti 56 Reputation points