Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,402 questions
5 answers
MIAuthenticator.toAdmsResponseToken failed
I have a dataset using a Rest api (Oauth2) linked service. The linked service is working just fine (see 1st picture) But when i try to use this dataset as a source in my dataflow i get the following message: (see 2nd picture) …
asked 2022-02-05T22:41:10.487+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 77%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERB%3C/text%3E%3C/svg%3E)
Raji Ben-Maaouia
1
Reputation point
answered 2022-09-29T12:56:39.483+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(41.6, 33%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAL%3C/text%3E%3C/svg%3E)
Audun Lie Indergaard
21
Reputation points
1 answer
Copy SQL database to Synapse dedicated SQL Pool
I have one Azure SQL Database(more than 1000 tables) that I need to copy into Azure Synapse Dedicated SQL Pool. What are the possible approaches to do that? I don't want to go for ADF Pipeline approach.
asked 2022-09-12T02:06:15.733+00:00
shilpa.vadgama@accenture.com
6
Reputation points
commented 2022-09-29T10:28:47.48+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 4%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
ShaktiSingh-MSFT
13,516
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
How to parse XML files with optional fields in ADF?
I have a XML file where we need flattening. The problem is some fields in the XML are optional(as per XSD). The field might be present or might not be. So fixed mapping based on XML is not working. We need mapping based on XSD so every scenario is…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 37%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
2 answers
One of the answers was accepted by the question author.
Synapse dedicated sqlpool partition switch: error trying to get the partition number based on a value or boundary
I am trying partition switching in a dedicated SQL pool in Synapse. Both tables, staging (temp) and destiny (final), have in common the same partition distribution, based on monthly cuts (e.g., 20190101, 20190201, 20190301 and so on). I have…
asked 2022-09-12T13:39:40.753+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 6%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMB%3C/text%3E%3C/svg%3E)
Miguel Buenestado
41
Reputation points
accepted 2022-09-29T07:03:13.02+00:00
Miguel Buenestado
41
Reputation points
1 answer
How can I, based on a ratio, split vertically a stream with a large number of columns using Azure Synapse Data Flow?
Hello everyone here, I am copying a file into Azure Data Lake Storage with more than 1500 columns and it will continue to grow(I have no control over how this is structured). Using Azure Synapse Data Flow, I need to automatically split the file…
asked 2022-09-17T19:12:17.987+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 14.000000000000002%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EC%3C/text%3E%3C/svg%3E)
Chaiwa
51
Reputation points
commented 2022-09-29T01:17:39.083+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT
46,422
Reputation points Microsoft Employee
1 answer
External Table issue in dedicated pool
Hello Team, I am trying to create a CREATE EXTERNAL TABLE for Synapse SQL to access data stored in Azure Blob Storage or Azure Data Lake Storage. Please below the error : CREATE EXTERNAL TABLE IF NOT EXISTS Salesforce.Account ( …
asked 2022-09-20T13:46:47.04+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 13%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Rohit Kulkarni
676
Reputation points
commented 2022-09-29T00:16:17.74+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
BhargavaGunnam-MSFT
26,316
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
How to access Synapse Studio when private endpoint is enabled?
I am having issue of opening Synapse Studio from portal when private endpoint enabled in Synapse. I am disabling Firewall, instead want to use private endpoint. Any help is appreciated?
asked 2022-08-15T22:43:09.077+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 40%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDM%3C/text%3E%3C/svg%3E)
Dinesh Madhup
46
Reputation points Microsoft Employee
accepted 2022-09-28T19:30:29.47+00:00
Dinesh Madhup
46
Reputation points Microsoft Employee
1 answer
Synapse df.to_parquet Write to Data Lake error
I am having this problem when trying to write the parquet file using the df.to_parquet command in the notebook. The command was working perfectly but now it does not work as intended. import fsspec import pandas from datetime import…
asked 2022-09-09T04:58:53.383+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 60%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESG%3C/text%3E%3C/svg%3E)
SoonJoo@Genting
241
Reputation points
commented 2022-09-28T18:02:27.92+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,381
Reputation points Microsoft Employee
1 answer
How to do extract Dynamic 365 Dataverse to export Azure synapse link to store the csv format in azure storage
I am new to this technologies and trying to connect under azure power apps there is option to connect azure synapse link to configure the azure storage gen2 and once connected, what ever the azure CRM 365 tables available, i can see the each table in…
asked 2022-09-06T09:05:25.563+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 46%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKE%3C/text%3E%3C/svg%3E)
Karthik Elavan
1
Reputation point
commented 2022-09-28T17:59:55.247+00:00
HimanshuSinha-msft
19,381
Reputation points Microsoft Employee
1 answer
Azure Synapse Merge Command is working with Error-"Updating a distribution key column in a MERGE statement is not supported."
Hello, I am doing a incremental load on target table using delta load from the source table based on certain conditions. It is supposed to insert/update/delete records from the source table to target table. I am achieving this through a sequence of…
asked 2022-09-06T06:38:44.003+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 57.00000000000001%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBN%3C/text%3E%3C/svg%3E)
Bhanurdra Narayan Mohapatra
1
Reputation point
commented 2022-09-28T17:59:11.31+00:00
HimanshuSinha-msft
19,381
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
look up activity
Hello, i would to ask about if lookup activity work the same way when i use lookup in SSIS
asked 2022-09-28T08:07:56.48+00:00
MUSTAFA AHMAD MUSTAFA AL-HUNAITI
166
Reputation points
accepted 2022-09-28T09:49:06.583+00:00
MUSTAFA AHMAD MUSTAFA AL-HUNAITI
166
Reputation points
1 answer
One of the answers was accepted by the question author.
Pyspark Synapse pool write speed pefromance
I am writing a pandas dataframe to my synapse dedicated sql pool and am using sqlalchemy to write to the pool using the code below from sqlalchemy import event @event.listens_for(engine, "before_cursor_execute") def…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(198.4, 49%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EW%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Output SQL server data into Parquet files
Hello, My requirements need me to export data from sql server ( on prem) db to ADLgen2 in an azure synapse analytics with parquet format. Currently, the need is to create parquet files of this data for consumption. what is best practice to do…
asked 2022-09-27T10:35:38.977+00:00
MUSTAFA AHMAD MUSTAFA AL-HUNAITI
166
Reputation points
accepted 2022-09-28T06:45:44.857+00:00
MUSTAFA AHMAD MUSTAFA AL-HUNAITI
166
Reputation points
0 answers
Azure Synapse Analystic pipeline: The TCP/IP connection to the host has failed
I have a pipeline that calls to execute pipeline activity each date from a date range which is input as parameters. But I don't know why I got an issue below while my SQL pool still queries successfully in SSMS. Operation on target DF_XX failed:…
asked 2022-09-14T11:10:52.56+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 18%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETQ%3C/text%3E%3C/svg%3E)
Trinh Quang Dat
91
Reputation points
commented 2022-09-27T21:27:32.443+00:00
KranthiPakala-MSFT
46,422
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Azure Dataflow Issue
Hi, I am running a pipeline which is containing only a Dataflow. This dataflow is just reading the data from excel and inserting data to azure synapse sql db and deleting the existing records from DB. My source excel containing 135000+ records. When…
asked 2022-09-15T15:21:54.17+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 51%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESD%3C/text%3E%3C/svg%3E)
Santhi Dhanuskodi
66
Reputation points
accepted 2022-09-27T18:25:06.957+00:00
Santhi Dhanuskodi
66
Reputation points
1 answer
Migration data
Hi there, I have a VPN on my device to make me connect to enterprise source data(SQL database). in my case, i wanna connect from VM using self-hosted integration runtime without using my VPN installed on my device. to better understand my…
asked 2022-09-26T12:28:45.76+00:00
MUSTAFA AHMAD MUSTAFA AL-HUNAITI
166
Reputation points
commented 2022-09-27T16:42:03.667+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
1 answer
Data integration
Hi there, I'm seeking guidance on data integration. I'm looking to integrate different sources which have different structures. For example: 2 companies merging. Their data is of same concept but each field could be named differently between…
asked 2022-09-19T16:17:45.763+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 69%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
RJ
106
Reputation points
commented 2022-09-27T16:05:26.677+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
0 answers
ADF Dataflow Excel error
Hi, I am trying to read an excel file in dataflow using source activity. In import projection and data preview itself, I get error 'Empty string'. When I open the excel file and expand some of the columns and reupload and run the dataflow, i…
asked 2022-09-20T08:01:44.173+00:00
Santhi Dhanuskodi
66
Reputation points
commented 2022-09-27T15:55:55.287+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
1 answer
Synapse - SAP successfactors connect
How can I copy data from SAP SuccessFactors into Azure Synapse Analytics? Can I use the "SAP table" connector? My colleague was doing this task, but I was assigned to it. He was using Rest API and SOAP API, but I am looking for an…
asked 2022-09-23T06:14:44.107+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(284.8, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Shunya Kakehi
1
Reputation point
commented 2022-09-27T15:46:05.403+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Develop ML Models in Synapse without Azure ML
Azure ML and Azure Devops are not white listed in my organisation and i'm relying on Synapse ML libraries to develop ML Models. Is there a way, i can deploy model manually as a web service using Synapse Notebooks, without relying on Azure ML or Azure…
asked 2022-09-21T11:34:53.293+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 81%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKS%3C/text%3E%3C/svg%3E)
Kumar, Senthil
156
Reputation points
accepted 2022-09-27T07:10:54.04+00:00
Kumar, Senthil
156
Reputation points