Microsoft Q&A

Azure Synapse Analytics

3,558 questions

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

Browse all Azure tags

3,558 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

Azure Access Needed for Cloud Data Router Project as a Student

Greetings Microsoft Azure Team, I hope you are doing well. I am Aryan Sadana, a B.Tech student at Samrat Ashok Technological Institute, Vidisha. I am contacting you to ask for access to Microsoft Azure services for a cloud data router project that is…

Azure Service Fabric
Azure Service Fabric
An Azure service that is used to develop microservices and orchestrate containers on Windows and Linux.
229 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
asked 2023-09-29T08:19:54.6633333+00:00
aryan Sadana 0 Reputation points
commented 2023-10-01T17:45:50.9266667+00:00
Amira Bedhiafi 4,631 Reputation points
1 answer

How to update the secret in keyvault from Synapse notebook

Hi, I'M generating a token in the synapse notebook. I want to update my secret stored in keyvault every time I run my Synapse notebook how can I achieve it could you please provide me the Python code so that I can change the secret value every time I run…

Azure Key Vault
Azure Key Vault
An Azure service that is used to manage and protect cryptographic keys and other secrets used by cloud apps and services.
894 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
asked 2023-09-28T15:36:04.6333333+00:00
Sasidhar R. Kolli 0 Reputation points
answered 2023-10-01T17:32:56.38+00:00
Amira Bedhiafi 4,631 Reputation points
3 answers

Sharepoint online list connector failed to connect

Hi, I am trying to fetch data from sharepoint online list to ADLS using synapse pipelines. For this I tried to follow the documentation as follows: …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
SharePoint
SharePoint
A group of Microsoft Products and technologies used for sharing and managing content, knowledge, and applications.
8,090 questions
asked 2021-09-01T04:10:48.45+00:00
Biswajeet Pruseth 21 Reputation points
answered 2023-10-01T16:20:03.4366667+00:00
Kasper Ulvedal 11 Reputation points
0 answers

Loading data incrementally from Synapse serverless pool External table to Azure SQL by using microsoft standard template pipeline but 'MergeData' script is failing with the error code "2011" and message is "Argument {0} is null or empty.\r\nParameter name

Loading data incrementally from Synapse serverless pool External table to Azure SQL by using microsoft standard template pipeline but 'MergeData' script is failing with the error code "2011" and message is "Argument {0} is null or…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,036 questions
asked 2023-10-01T14:09:32.9533333+00:00
ram V 0 Reputation points
0 answers

Long running Synapse Pipeline failed with InvalidHttpRequestToLivy exception

I have a long running azure synapse pipeline which will run notebook on spark pool. After 2 hours It failed with below exception. { "errorCode": "6002", "message": "InvalidHttpRequestToLivy: Submission failed…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
asked 2023-09-29T12:44:49.4633333+00:00
Ramachandraiah, Putta 0 Reputation points
edited a comment 2023-09-30T11:17:43.5666667+00:00
Harishga 100 Reputation points Microsoft Vendor
0 answers

ADF throwing 403 error while copying

Hi, I have Azure synapse analytics setup with private endpoint and I am running a ADF pipeline but it throws the error: {     "errorCode": "2200",     "message":…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,036 questions
asked 2023-09-29T17:10:11.98+00:00
Rajaniesh Kaushikk 466 Reputation points
commented 2023-09-30T09:32:10.0166667+00:00
Smaran Thoomu 185 Reputation points Microsoft Vendor
0 answers

ADF stored procedure glitch when ran via trigger

I have a database stored procedure with one of below code snippets in it. Now problem is when I call this stored procedure via ADF pipeline stored procedure activity. The Database SP is working as expected when ADF pipeline is ran in debug mode or SP is…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,036 questions
asked 2023-09-28T01:33:45.82+00:00
NIKHIL KUMAR 81 Reputation points
commented 2023-09-30T08:19:15.6466667+00:00
phemanth 230 Reputation points Microsoft Vendor
1 answer

Unable to run Sql queries in Azure Synapse. Error: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException

Hi, I have deployed a Synapse workspace through devops and running some sql queries inside it. I can run simple SQL queries but can not run anything related to Delta Table. Commands like - SHOW TABLES %%sql CREATE DATABASE AdventureWorksLT2019…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,130 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
asked 2022-01-24T04:26:54.117+00:00
Yash Tamakuwala 1 Reputation point
edited a comment 2023-09-30T08:14:54.87+00:00
Nikhilesh Negi 0 Reputation points
2 answers One of the answers was accepted by the question author.

Global parameters for Synapse Analytics pipelines

Hi, I need to implement a dwh solution by using Synapse Analytics and I'd like using global parameters as in Azure Data Factory, but it seems that a such feature isn't present in Synapse. Now, is global parameters feature supported in Synapse,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,036 questions
asked 2023-09-29T07:03:39.36+00:00
pmscorca 197 Reputation points
edited a comment 2023-09-29T17:34:02.2266667+00:00
pmscorca 197 Reputation points
1 answer

Cross region Dedicated SQL Pool data consumption

Hi, I have a requirement as below kindly show some light. We have Dedicated SQL pool in one resource group would say for global requirement. For local country requirements, we are using serverless sql pool, azure sql DB in different RG. Both resides in…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
asked 2023-09-29T15:48:29.47+00:00
Muruga Muthukrishnan 20 Reputation points
answered 2023-09-29T17:01:53.7966667+00:00
Vahid Ghafarpour 6,230 Reputation points
1 answer

select statement on notebook in lookup transformation in ADF

Hi Expert. how to use the select statement on notebook to pass parameter in lookup transformation

Azure SQL Database
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,130 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,606 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,036 questions
asked 2023-09-27T04:43:35.03+00:00
Shambhu Rai 1,021 Reputation points
commented 2023-09-29T16:05:21.35+00:00
Shambhu Rai 1,021 Reputation points
2 answers One of the answers was accepted by the question author.

ASKs FOR LOG ANALYTICS IN SYNAPSE WORKSPACE

1.- I would like to know how I can view the login, session failure and logout of a user in the synapse workspace log analytics when they enter the synapse studio? 2.-I would like to know why in the SqlSecurityAuditEvents table of the synapse workspace…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
asked 2023-09-14T16:43:49.1666667+00:00
Gabriel Lazo 21 Reputation points
commented 2023-09-29T14:50:23.6633333+00:00
Smaran Thoomu 185 Reputation points Microsoft Vendor
1 answer

How to make the Azure Synapse blob trigger work?

I've been struggling for weeks to activate the blob event trigger in Microsoft Azure. The goal is to initiate an Azure Synapse pipeline whenever a blob is created in the path "requests/inputs/{some_blob}.json." I completed the configuration,…

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
1,963 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
Azure Event Grid
Azure Event Grid
An Azure event routing service designed for high availability, consistent performance, and dynamic scale.
268 questions
asked 2023-09-27T17:04:22.88+00:00
Leonardo Kuster Degasperi 0 Reputation points
commented 2023-09-29T13:18:36.6566667+00:00
Smaran Thoomu 185 Reputation points Microsoft Vendor
0 answers

How can I install a chrome browser in synapse notebooks?

I am using a synapse notebook with pyspark to run Selenium. Using bash code in the notebook (%%sh) I was able to download a google chrome driver but my trusted-service-user username is not able to access the root and use sudo to download the Chrome…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
PowerShell
PowerShell
A family of Microsoft task automation and configuration management frameworks consisting of a command-line shell and associated scripting language.
1,317 questions
asked 2023-09-11T18:17:02.17+00:00
Evan Brody 0 Reputation points
commented 2023-09-29T12:35:20.3366667+00:00
Evan Brody 0 Reputation points
0 answers

Tableau connection fails intermittently to synapse database

I am having intermittent fails in tableau jobs, please see the job execution summary Observation: •There is no difference in connection parameter for both success and failure. •Both the Jobs are executed from Node-4 and the Driver is also same. •The…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
asked 2023-09-26T10:36:14.14+00:00
Imran Akbar 20 Reputation points
commented 2023-09-29T10:29:07.9133333+00:00
Imran Akbar 20 Reputation points
1 answer

How to use Azure Synapse link to replicate D365 data from power apps platform/ Dataverse to ADLS 2.0?

I need to discontinue to use the "Data export service" from Dynamic 365 to replicate data to ADLS 2.0, and configure the same replication using Azure synapse link. Can someone please share the process?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
asked 2023-09-26T19:08:33.34+00:00
Dharmesh, D Developer Admin 5 Reputation points
answered 2023-09-29T02:50:46.1133333+00:00
AnnuKumari-MSFT 26,811 Reputation points Microsoft Employee
1 answer

How to fix error with OPENROWSET view on Delta table?

Error: Query failed because of compute container failures or other transient errors, and retry exhausted. This can be an intermittent issue. Please retry later. OPENROWSET view on Serverless Pool (format = delta) is failing with the above error. All…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
asked 2023-09-26T09:13:34.5266667+00:00
Harry DK 0 Reputation points
commented 2023-09-28T22:12:06.26+00:00
BhargavaGunnam-MSFT 19,561 Reputation points Microsoft Employee
0 answers

Migrating Dedicated SQL Pool to Serverless

Currently the setup is a dedicated sql pool (DW300). The tables are external tables, which have parquets as a source. We would like to migrate this to serverless. How can we do this migration ?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
asked 2023-09-28T08:30:09.4533333+00:00
Joël Lezana Rienks 0 Reputation points
commented 2023-09-28T22:11:44.62+00:00
KranthiPakala-MSFT 43,432 Reputation points Microsoft Employee
1 answer

How to point External Tables in Dedicated SQL Pool to Storage Secondary End Point ?

All, What is the procedure to point external tables in the Dedicated SQL Pool to the container secondary endpoint, in case of a disaster recovery scenario when a pool is restored in the secondary region? Which method can be used for this task? Your…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
asked 2023-07-10T12:02:44.7333333+00:00
PS 311 Reputation points
commented 2023-09-28T17:14:57.3033333+00:00
PS 311 Reputation points
0 answers

How to get logs from synapse job to send to Azure eventhub via Spark Diagnostic emitter extension

Hi - I am trying have logs sent to an Azure Eventhub via the Azure Synapse Diagnostic Emitter Eventhub. I am able send and receive logs via a notebook by having the pool that the notebook runs configured following the above documentation. import…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,558 questions
asked 2023-09-22T20:53:38.63+00:00
natalie 6 Reputation points Microsoft Employee
commented 2023-09-28T16:49:23.74+00:00
natalie 6 Reputation points Microsoft Employee