Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,369 questions
1 answer
One of the answers was accepted by the question author.
Azure Dataflow Issue
Hi, I am running a pipeline which is containing only a Dataflow. This dataflow is just reading the data from excel and inserting data to azure synapse sql db and deleting the existing records from DB. My source excel containing 135000+ records. When…
asked 2022-09-15T15:21:54.17+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 51%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESD%3C/text%3E%3C/svg%3E)
Santhi Dhanuskodi
66
Reputation points
accepted 2022-09-27T18:25:06.957+00:00
Santhi Dhanuskodi
66
Reputation points
1 answer
Migration data
Hi there, I have a VPN on my device to make me connect to enterprise source data(SQL database). in my case, i wanna connect from VM using self-hosted integration runtime without using my VPN installed on my device. to better understand my…
asked 2022-09-26T12:28:45.76+00:00
MUSTAFA AHMAD MUSTAFA AL-HUNAITI
166
Reputation points
commented 2022-09-27T16:42:03.667+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
1 answer
Data integration
Hi there, I'm seeking guidance on data integration. I'm looking to integrate different sources which have different structures. For example: 2 companies merging. Their data is of same concept but each field could be named differently between…
asked 2022-09-19T16:17:45.763+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 69%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
RJ
106
Reputation points
commented 2022-09-27T16:05:26.677+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
0 answers
ADF Dataflow Excel error
Hi, I am trying to read an excel file in dataflow using source activity. In import projection and data preview itself, I get error 'Empty string'. When I open the excel file and expand some of the columns and reupload and run the dataflow, i…
asked 2022-09-20T08:01:44.173+00:00
Santhi Dhanuskodi
66
Reputation points
commented 2022-09-27T15:55:55.287+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
1 answer
Synapse - SAP successfactors connect
How can I copy data from SAP SuccessFactors into Azure Synapse Analytics? Can I use the "SAP table" connector? My colleague was doing this task, but I was assigned to it. He was using Rest API and SOAP API, but I am looking for an…
asked 2022-09-23T06:14:44.107+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(284.8, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Shunya Kakehi
1
Reputation point
commented 2022-09-27T15:46:05.403+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Develop ML Models in Synapse without Azure ML
Azure ML and Azure Devops are not white listed in my organisation and i'm relying on Synapse ML libraries to develop ML Models. Is there a way, i can deploy model manually as a web service using Synapse Notebooks, without relying on Azure ML or Azure…
asked 2022-09-21T11:34:53.293+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 81%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKS%3C/text%3E%3C/svg%3E)
Kumar, Senthil
156
Reputation points
accepted 2022-09-27T07:10:54.04+00:00
Kumar, Senthil
156
Reputation points
1 answer
Reading a Delta table from ADLS Gen2 in Python
Hi, I've created a Delta table in an ADLS Gen2 and need to load the locally using Python. I've tried using this approach unsuccessfully: https://pypi.org/project/delta-lake-reader/ with the error "Could not find transaction logs in path…
asked 2022-09-21T09:04:34.477+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 55.00000000000001%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJR%3C/text%3E%3C/svg%3E)
Johan á Rogvi-Hansen
101
Reputation points
commented 2022-09-27T05:11:22.96+00:00
PRADEEPCHEEKATLA-MSFT
77,081
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Synapse Copy activity with Auto create does not work
Trying to use Synapse copy activity to copy data from Parquet source file to Synapse dedicated pool table. Target table does not exist , so trying to use the AutoCreate option . Given a dummy table name is the target dataset. When giving the…
asked 2022-02-02T05:10:43.187+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(25.6, 55.00000000000001%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESG%3C/text%3E%3C/svg%3E)
Sunita Gannavarapu
66
Reputation points Microsoft Employee
commented 2022-09-26T23:15:46.713+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 54%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EL%3C/text%3E%3C/svg%3E)
Lukeh
1
Reputation point
1 answer
One of the answers was accepted by the question author.
Invoke synapse notebook as soon as spark pool starts
Hi, I have read access on synapse workspace, and I want synapse notebook to trigger automatically without any manual intervention. Let's say the environment is production, how will the synapse notebook will run on it's own? The notebook has…
asked 2022-09-22T09:09:27+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 56.00000000000001%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Suraj Tripathi
72
Reputation points Microsoft Employee
accepted 2022-09-26T17:22:21.72+00:00
Suraj Tripathi
72
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Azure Synapse Managed VNET - Connect to Snowflake without Private Endpoint
We have a synapse analytics workspace created with a managed virtual network and are attempting to create a linked service to Snowflake without using a private endpoint. We don't want to use Snowflake private endpoints because we're trying to keep our…
asked 2022-09-21T12:32:32.863+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 46%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chris Burke
21
Reputation points
accepted 2022-09-26T12:51:06.973+00:00
Chris Burke
21
Reputation points
2 answers
TLS 1.3 on JDBC connections to Azure SQL or Synapse
Hello, Is TLS 1.3 supported on JDBC connections to Azure SQL or Synapse? Thanks, Talha
asked 2022-09-15T08:21:15.823+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 12%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETS%3C/text%3E%3C/svg%3E)
Talha Soysal
1
Reputation point
commented 2022-09-26T06:07:15.353+00:00
PRADEEPCHEEKATLA-MSFT
77,081
Reputation points Microsoft Employee
0 answers
While executing a notebook from another notebook session gets closed
I have created parent notebook in synapse which reads metadata from Azure sql server where multiple notebooks name are stored. Using for loop it iterates the metadata and executes the notebook in each iteration. But some times the execution gets stopped…
asked 2022-09-18T19:31:10.62+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 52%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHD%3C/text%3E%3C/svg%3E)
heta desai
247
Reputation points
commented 2022-09-26T05:26:44.997+00:00
heta desai
247
Reputation points
1 answer
Parallel Synapse Spark Application Run
Hi, I´ve recently created my synapse workspace and when I tryied to run more then 1 notebook in parallel, I got an error that I don´t have enough vcores to run the notebooks. I´ve created a service request to increase my quota of vcores to 50, but I´ve…
asked 2022-09-16T14:39:57.133+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 97%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERC%3C/text%3E%3C/svg%3E)
Ricardo Cauduro
1
Reputation point
commented 2022-09-23T19:42:16.267+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
BhargavaGunnam-MSFT
26,136
Reputation points Microsoft Employee
1 answer
How to Insert hexadecimal value(timestamp data type) from SQL Server to syapse Delta lake table as string type
There is a column in SQL Server with timestamp datatype which stores hexadecimal value like '0x00000000018B8199 ' . I want to load this data into synapse delta lake table as string. I am using pipeline and data load Data from SQL Server to synapse delta…
asked 2022-09-18T19:17:33.217+00:00
heta desai
247
Reputation points
commented 2022-09-23T10:48:47.533+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Issues to acquire Spark Session with Synapse Spark Pool
We are experiencing issues when working with Spark Pools in Synapse. The issues started on tuesday, where we got an information from Azure Support, that there was an ongoing issue for West Europe It was working on Wednesday and it is starting to…
asked 2022-09-22T14:59:58.317+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 91%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJB%3C/text%3E%3C/svg%3E)
Julian Breunung
22
Reputation points
commented 2022-09-23T10:05:28.793+00:00
ShaikMaheer-MSFT
37,896
Reputation points Microsoft Employee
2 answers
Azure synapse notebook is throwing 403 forbidden error when inserting data into dedicated pool
Hi Team, When I am trying to use Sql Analytics command for writing data into dedicated pool I am getting 403 forbidden error stating unable to access Azure data lake storage account but I am able to access Azure data lake storage account and read files…
asked 2021-02-10T01:07:43.207+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 6%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESA%3C/text%3E%3C/svg%3E)
Shobhit Awasthi
16
Reputation points
commented 2022-09-23T09:06:19.28+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 54%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EY%3C/text%3E%3C/svg%3E)
yak
1
Reputation point
1 answer
Synapse pipeline lineage is not pushed to Purview
Hi guys, I have a Synapse workspace connected to my Purview: I just ran a synapse pipeline that launch several mapping dataflows sequentially: The last two mapping data flows fill two Synapse tables: DF_CUR_ODS_OBJET_ASSURE,…
asked 2022-06-16T14:39:58.867+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 44%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMB%3C/text%3E%3C/svg%3E)
Manuel Bustamante
42
Reputation points
commented 2022-09-23T07:16:00.747+00:00
Manuel Bustamante
42
Reputation points
1 answer
One of the answers was accepted by the question author.
Connect serverless SQL pool and Power BI using a data base user
Hello Microsoft Q&A, I have the following problem: I want to use Power BI to get some insights about my data in my Azure Data Lake Gen2. I have created a serverless sql pool and in that pool I created a bunch of external tables. I was able…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 35%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EL%3C/text%3E%3C/svg%3E)
3 answers
Azure Synapse Analytics Failed to setup debug session
Right now I'm not able to run a data flow task on our Azure Synapse environment. When I try to start a debug session I get the message Failed to setup debug session. When I trigger the pipeline instead the task fails with "Operation on target…
asked 2022-09-20T12:40:49.163+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 8%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Anonymous
commented 2022-09-23T06:37:26.16+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 37%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EC%3C/text%3E%3C/svg%3E)
Cylon12
1
Reputation point
1 answer
ADF Azure Hosted Integration Runtime IP Whitelist to access Synapse SQL Pool
I am attempting to connect my ADF with a synapse pool, both resources sit in different subscriptions. My ADFis using an azure hosted IR in UK South region. I have whitelisted the UK SOUTH ADF IR IP ranges as per below from this doc …
asked 2022-09-16T11:25:49.333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(198.4, 49%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EW%3C/text%3E%3C/svg%3E)
WZIAFP
157
Reputation points
commented 2022-09-22T22:22:20.973+00:00
BhargavaGunnam-MSFT
26,136
Reputation points Microsoft Employee