4,422 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer One of the answers was accepted by the question author.

synapse analytics environment

hello, How is it possible to create a synapse environment by running a script as opposed to using the azure portal? Thank you

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-08-08T12:56:18.797+00:00
arkiboys 9,646 Reputation points
accepted 2022-08-08T18:55:17.503+00:00
arkiboys 9,646 Reputation points
1 answer One of the answers was accepted by the question author.

Azure Synapse Bitbucket integration

Is there a way, i can use Bitbucker for source control. If Bitbucket integration feature is on the roadmap, is there an alternate solution for this? Synapse to GitHub and from GitHub to Bitbucket

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-07-26T09:46:52.083+00:00
Kumar, Senthil 156 Reputation points
accepted 2022-08-08T07:46:52.727+00:00
Kumar, Senthil 156 Reputation points
0 answers

Can we trigger a synapse pipeline based on Event Grid system topic output

Hi Team, Currently we have an event grid system topic which triggers an azure function to create views on synapse serverless pool. Once the above process is done, we move the data from serverless to dedicated sql pool. we would like to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,643 questions
Azure Event Grid
Azure Event Grid
An Azure event routing service designed for high availability, consistent performance, and dynamic scale.
318 questions
asked 2022-07-06T12:07:52.797+00:00
Jakeer Shaik 106 Reputation points
commented 2022-08-08T07:35:00.713+00:00
Jakeer Shaik 106 Reputation points
1 answer One of the answers was accepted by the question author.

Datafactory Event Trigger Unable to list Blobs

Hello everybody, I am trying to set up an event trigger for a blob creation event in my synapse workspace but somehow I can't seem to make it work. I can find the storage account and the container. But when I want to filter for files it simply states…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,643 questions
asked 2022-07-29T09:46:43.147+00:00
Mathias Grüner 31 Reputation points
accepted 2022-08-08T05:32:13.667+00:00
Mathias Grüner 31 Reputation points
3 answers One of the answers was accepted by the question author.

How do I remove the row in Excel file? - Azure Synapse Analytics

Hi, I wanna remove the row in Excel file in Azure Synapse Analytics. As shown in the attached image, the source Excel file has an unnecessary second row. I tried to remove it in ADF, but I don't know what condition to set in the component…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,355 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,643 questions
asked 2022-08-04T08:58:04.147+00:00
Kakehi Shunya (筧 隼弥) 201 Reputation points
commented 2022-08-08T05:21:41.31+00:00
Kakehi Shunya (筧 隼弥) 201 Reputation points
1 answer

Is the Azure notebookutils python package available to on a local development system?

We are developing a python application to run in Azure Synapse. We want to use mssparkutils, which is part of the notebooktuils package. It doesn't appear that notebookutils is available in the pypi index to be downloaded locally. Is it available…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-07-29T13:52:11.97+00:00
Jarrett Anderson 16 Reputation points
commented 2022-08-05T16:55:21.383+00:00
MartinJaffer-MSFT 26,036 Reputation points
1 answer

Load mutiple files listed in a dataframe to a dataframe

I have a list of files from my ADLS storage in a dataframe as per the image below. What I would like to do is to load the files listed in accountdf into one dataframe. Can someone provide some pointers.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,355 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-07-28T09:17:03.303+00:00
WZIAFP 157 Reputation points
commented 2022-08-05T09:17:58.177+00:00
PRADEEPCHEEKATLA-MSFT 78,331 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Want to migrate from one Synapse workspace to another Synapse workspace

Hi team, Want to migrate from one Synapse workspace to another Synapse workspace. One being Dev environment, another one test environment. Please provide leads. Regards, NagaSri

Azure Database Migration service
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,355 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,947 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,643 questions
asked 2021-10-18T15:17:49.867+00:00
Naga 66 Reputation points
commented 2022-08-05T09:06:50.573+00:00
PRADEEPCHEEKATLA-MSFT 78,331 Reputation points Microsoft Employee
2 answers One of the answers was accepted by the question author.

Is there a way to create a pipeline that stops all triggers at once?

Is there a way to create a pipeline that stops all triggers at once? I need to stop all triggers at the time of release to release, so if there is a good way to do this, please let me know.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-07-19T01:06:18.85+00:00
NishimuraChinatsu-9854 756 Reputation points
accepted 2022-08-05T08:58:54.463+00:00
NishimuraChinatsu-9854 756 Reputation points
1 answer

How to create External table with different collation

Please confirm can we create a External table with Different collation on Azure Synapse Database. Can we have different collation on object level ? Azure Synapse Database collation : Default (SQL_Latin1_General_CP1_CI_AS) Expected Table creation…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-07-25T14:48:21.027+00:00
Mallikarjuna Avula 1 Reputation point
commented 2022-08-04T20:10:31.407+00:00
BhargavaGunnam-MSFT 26,496 Reputation points Microsoft Employee
1 answer

Temporal Tables

Hi everyone, Does Synapse Analytics support Temporal Tables ? What are the components/services that do support temporal tables? Thank you

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-07-28T14:51:46.263+00:00
Aouatef Rouahi 1 Reputation point
commented 2022-08-04T20:08:16.023+00:00
BhargavaGunnam-MSFT 26,496 Reputation points Microsoft Employee
3 answers One of the answers was accepted by the question author.

Copy data activity in Synapse - ADLS2 to dedicated SQL Pool - Wildcard problem

Hi everyone, I am using the copy data activity in a Synapse pipeline to load data from azure data lake v2 to a SQL dedicated pool. I'm facing a problem to read several parquet files from a directory in the data lake. The folder has a simple…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2021-04-20T19:01:54.177+00:00
Paul Hernandez 631 Reputation points Microsoft Employee
commented 2022-08-04T16:52:21.427+00:00
Green, Cathy 1 Reputation point
2 answers One of the answers was accepted by the question author.

Creating external table using delta format in Azure Synapse ADLS Gen 2

Hello, I want to create a external table using the delta format in Azure Synapse. I'm using a ADLS Gen 2 Data Lake. Here is the relevante part of the script I'm using to create the table: WITH ( LOCATION = 'test/staging/CaseComment/**', …

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,355 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-08-01T07:02:08.487+00:00
Lukas 151 Reputation points
accepted 2022-08-04T06:09:47.723+00:00
Lukas 151 Reputation points
1 answer

How to install nuget packages from ADLS to synapse notebooks ?

Hi, Previously in our project we have used #r command to install the nuget packages. But due to private endpoint restrictions we are unable to install directly. Can anyone help me how can I use the nuget packages from ADLS primary storage to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-07-18T04:19:52.94+00:00
Radha Pusarapu (Ernst & Young LLP) 31 Reputation points Microsoft Vendor
commented 2022-08-03T18:44:17.313+00:00
BhargavaGunnam-MSFT 26,496 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Azure Dedicated SQL Pool (Formerly SQL DW) : Not able to connect the server with my AD account

Hi, Could you please guide me on connection issue ? I used to connect the Azure Dedicated SQL Pool (Formerly SQL DW) through SQL Server Management Studio with my Azure AD credential. It was working till yesterday (26th July 2022). But, Today I am…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-07-27T11:25:37.197+00:00
Seenuvasan, Venkatanathan 56 Reputation points
commented 2022-08-03T10:37:35.05+00:00
Alberto Morillo 32,896 Reputation points MVP
1 answer One of the answers was accepted by the question author.

Synapse R Integration

I believe R integration is not available in Synapse for now, is there any alternate work around to integrate R with Synapse?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-07-29T07:18:29.77+00:00
Kumar, Senthil 156 Reputation points
accepted 2022-08-03T07:43:28.03+00:00
Kumar, Senthil 156 Reputation points
1 answer

Azure Synapse Lake Database on SQL Serverles Pool Error: Operation DROP FUNCTION is not allowed for a replicated database.

Hello Community, When I attempt to execute the following code on our Azure Synapse Lake Database I get the error: Operation DROP FUNCTION is not allowed for a replicated database. The code that generates the error is as follows: DECLARE…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-07-27T10:45:58.503+00:00
Anonymous
commented 2022-08-03T05:18:55.67+00:00
AnnuKumari-MSFT 31,151 Reputation points Microsoft Employee
1 answer

What is the impact of Databricks IP allow/denylists on orchestration using ADF/Synapse

Databricks jobs are often scheduled using Azure Data Factory and/or Synapse. What is the impact of Databricks IP access lists on this orchestration? Can we add service tags to the whitelist to allow ADF? Thanks for elaborating.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,947 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,643 questions
asked 2022-07-28T09:17:09.643+00:00
wout 1 Reputation point
commented 2022-08-02T23:04:44.377+00:00
KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
4 answers

Synapse Studio - 403 Unauthorised - Even with Owner permissions

I am having trouble access Synapse Studio for a workspace that I have "Owner" permissions to.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-02-11T15:42:53.813+00:00
Alex Driver 1 Reputation point
answered 2022-08-02T00:41:57.147+00:00
Gaurav Batta 11 Reputation points
1 answer One of the answers was accepted by the question author.

Onprem SQL Server password saved to KeyVault doesn't work on LinkedService

Failed to get the secret from key vault, secretName: XYZ, secretVersion: 123, vaultBaseUrl: https://abc.vault.azure.net/. The error message is: An error occurred while sending the request. Unable to connect to the remote server A connection…

Azure Key Vault
Azure Key Vault
An Azure service that is used to manage and protect cryptographic keys and other secrets used by cloud apps and services.
1,135 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-07-29T16:59:25.893+00:00
Venkat Bommavaram 21 Reputation points
accepted 2022-08-01T21:22:37.12+00:00
Venkat Bommavaram 21 Reputation points