Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,003 questions
1 answer
Dataflow debug only shows 100 rows even if the query returns >100 records. Row limit is set to 1000.
Dataflow debug only shows 100 rows in the web UI in tabular format even if the query returns >100 records. Row limit is set to 1000. Is this the default behavior in azure synapse analytics? I know this is a display only behavior as I am able to join…
asked 2024-11-14T15:57:56.0666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 86%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENS%3C/text%3E%3C/svg%3E)
Nandu S Raj
20
Reputation points
commented 2024-11-18T07:43:33.8166667+00:00
AnnuKumari-MSFT
33,476
Reputation points Microsoft Employee
1 answer
Getting error "Login failed for user '
I have a resource group under which I have created a sql pool and Synapse workspace. Whenever I am running a query like "CREATE SCHEMA foodmart" it is giving the following error. "Login failed for user '
asked 2024-11-14T10:31:52.93+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 22%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
Shiv
0
Reputation points
commented 2024-11-18T06:29:09.1966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
1,430
Reputation points Microsoft Vendor
1 answer
Need to automate a Synapse Analytics Pipeline to gather the information from the previous day. every day
I have a Synapse Analytics Pipeline that gather information from SharePoint and put it into a storage account container in Azure. It is a Copy data action. Right now, every time I need to get more data, I need to change the date on Source /Date filter…
asked 2024-11-12T20:28:56.61+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 49%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAN%3C/text%3E%3C/svg%3E)
Alex Nieto Castro
0
Reputation points
commented 2024-11-18T06:05:55.5566667+00:00
Ganesh Gurram
1,430
Reputation points Microsoft Vendor
1 answer
How can I write to a Dataverse lookup using an alternate key?
Hi I want to write data to Dataverse via a Synapse Copy Data task in a pipeline. The destination tables all have alternate keys set up. So for example, I could have a Country entity, with CountryAlternateKey (e.g. ISO code) and Name, and a City with…
asked 2024-11-13T10:32:20.5433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 86%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDP%3C/text%3E%3C/svg%3E)
Duncan Pryde
1
Reputation point
commented 2024-11-18T01:16:54.73+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
3,230
Reputation points Microsoft Vendor
0 answers
Identifying Unused Tables in AAS Cube Over the Last 30 Days
I have a question regarding identifying unused tables in Azure Analysis Services (AAS). In our organization, we’re using AAS, and due to limited storage, our cube refresh is failing. I’ve been tasked with finding a list of tables that haven’t been used…
asked 2024-11-07T16:03:40.6433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(19.2, 76%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
madmax
0
Reputation points
commented 2024-11-18T01:11:38.5233333+00:00
Chandra Boorla
3,230
Reputation points Microsoft Vendor
2 answers
How to save complete web activity output to ADLS Gen2 in JSON format? Azure Synapse Studio
I want to save the output of my Web activity (which hits an Api and then fetches data from that Api in Json format) into blob storage account container. Also, my web activity is within a foreach - so multiple Api links are being hit and multiple files…
asked 2024-10-24T05:42:30.79+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 20%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Mitashi Malkani
0
Reputation points
commented 2024-11-18T01:09:46.1633333+00:00
Chandra Boorla
3,230
Reputation points Microsoft Vendor
3 answers
Error using model.fit() in Synapse Apache Spark notebook
I have an unpredictable error. com.fasterxml.jackson.databind.exc.MismatchedInputException: No content to map due to end-of-input at [Source: (String)""; line: 1, column: 0] I would like to train a time series model using SARIMAX with four…
asked 2023-07-17T14:39:07.5533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 54%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Abdelmonim Klaii
20
Reputation points
commented 2024-11-16T14:00:17.0766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(140.8, 76%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Alexey Kazakov
0
Reputation points
2 answers
Parametrization for connection string is not working in linked service
Hi there, I have solution - data pipeline in Synapse taking data from mysql database. I need to parametrize it to be able run process across many environemnts (CI/CD). I set many linked services with code referencing on variable in yml file in style…
asked 2024-11-07T19:55:32.4766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 49%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPM%3C/text%3E%3C/svg%3E)
Peter Michalik
0
Reputation points
commented 2024-11-15T19:30:22.4433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
11,455
Reputation points Microsoft Vendor
3 answers
In my ADF I have few pipelines, is it possible to Export / Migrate those pipelines in Synapse Analytics...?
In ADF I have grouped all the activities in the form of Pipelines, So is it possible to migrate or export those pipelines in Azure Synapse.
asked 2024-11-13T01:17:17.1666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 89%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESB%3C/text%3E%3C/svg%3E)
Shreyash Betwar
0
Reputation points
commented 2024-11-15T13:57:07.51+00:00
Ganesh Gurram
1,430
Reputation points Microsoft Vendor
0 answers
How to add expression on result of aggregate function when create Materialized View in Synapse
Hi there, When I creating materialized view in synapse, i got an error, it says "because the select list of the view contains an expression on result of aggregate function or grouping column. Consider removing expression on result of aggregate…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 53%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZ%3C/text%3E%3C/svg%3E)
1 answer
D365 F&O synchronisation table dans spark (GEN 2) , comment modifier la structure de la table
Bonjour pour des besoins d'interfaces nous avons mis en place la réplication de certaines table de D365 F&O par le biais de la power plateforme (GEN 2) qui a créé un pool Spark dans synapse mais j'ai un champs de table qui ne récupère pas la bonne…
asked 2024-11-12T12:05:20.9866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(294.40000000000003, 40%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAO%3C/text%3E%3C/svg%3E)
Admin Office
0
Reputation points
commented 2024-11-15T04:28:41.21+00:00
Chandra Boorla
3,230
Reputation points Microsoft Vendor
1 answer
Insufficient System Memory in Synapse Analytics Pipeline
Encountering issues with a Synapse Analytics Pool where the pipeline run fails with the error message: "Operation on target GetLastChangedFeedFiles failed: There is insufficient system memory in resource pool 'VDWFrontendPool' to run this…
asked 2024-11-11T13:46:07.5766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(208, 23%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERD%3C/text%3E%3C/svg%3E)
rajib.de@outlook.com
0
Reputation points
commented 2024-11-14T01:47:50.2866667+00:00
Chandra Boorla
3,230
Reputation points Microsoft Vendor
1 answer
Timeout error due to Error reading SSH protocol banner
Hi Team, We are facing ‘Timeout error due to Error reading SSH protocol banner’ while trying to connect to sftp server through Azure Synapse Notebook. We are using python as source language and paramiko version 2.12.0 to connect to the server and…
asked 2024-11-04T13:32:47.8733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(83.2, 69%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Abhilasha Kumar
0
Reputation points
commented 2024-11-14T01:46:14.1433333+00:00
Chandra Boorla
3,230
Reputation points Microsoft Vendor
1 answer
Retrieving schema of purview scanned assets with object type is file also,i want to retrieve the schema of assets scanned with Cosmos db as source
I could get the schema for Object type is Tables in purview, but i couldn't retrieve for the object type is files,when I am calling atlas API the schema i get is empty[].
asked 2024-11-12T07:25:42.8766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 0%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBH%3C/text%3E%3C/svg%3E)
Bandi Harsha Nandini
0
Reputation points
commented 2024-11-14T01:20:11.8233333+00:00
Chandra Boorla
3,230
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Adding a non AKV Linked Service does not modify the publish branch in Azure Synapse Analytics
I tried adding a non-AKV based linked service from a feature branch. As per MS Git troubleshoot doc for synapse, it should publish to the azure live synapse service directly, which it did, but it did not create a commit in the publish branch. The doc is…
asked 2024-10-31T17:31:49.0666667+00:00
Nandu S Raj
20
Reputation points
commented 2024-11-13T15:50:52.9166667+00:00
Nandu S Raj
20
Reputation points
1 answer
One of the answers was accepted by the question author.
Web activity is throwing an error in adf pipeline
One of the web activities in my adf pipeline is throwing an error : Error calling the endpoint 'https://acp-01-appkv.vault.azure.net'. Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] The remote…
asked 2023-11-16T17:55:56.0766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 76%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAJ%3C/text%3E%3C/svg%3E)
Ashish Jayantibhai Kadavla
25
Reputation points
commented 2024-11-13T08:48:31.6066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(76.8, 77%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAM%3C/text%3E%3C/svg%3E)
ABDULLA, MAHAMMAD
21
Reputation points
1 answer
One of the answers was accepted by the question author.
Unable to delete Azure Synapse Workspace even through Powershell force deletion
Hello Team, I am unable to delete synapse analytics even though following up post through webUI or powershell. I tried following the steps mentioned in the link below :-…
asked 2024-11-06T21:31:49.4833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(19.2, 52%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EV%3C/text%3E%3C/svg%3E)
vaddi_dataengineer
20
Reputation points
accepted 2024-11-13T00:42:26.7566667+00:00
vaddi_dataengineer
20
Reputation points
1 answer
One of the answers was accepted by the question author.
Serialization Exception after changing reading from attached ADLS account to the same ADLS Account but through a linked service.
Currently we are running a Synapse Notebook that reads from the "Primary ADLS Gen2 account" and parse data to JSON. This job has been running stable for a while now. We need to run the same logic but read from a different ADLS account instead,…
asked 2024-11-08T22:49:30.5733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 44%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJG%3C/text%3E%3C/svg%3E)
Jose Gonzalez Gongora
25
Reputation points Microsoft Employee
accepted 2024-11-12T21:19:02.3533333+00:00
Jose Gonzalez Gongora
25
Reputation points Microsoft Employee
1 answer
RBAC permissions for debugging synapse data flow
Hi All. I am getting the error below when trying to debug a pipeline within Azure synapse You do not have required Synapse RBAC permission to perform this action. Contact a Synapse Administrator for this workspace. Required permission: Actions:…
asked 2024-10-24T22:22:31.36+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(80, 39%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
MrFlinstone
581
Reputation points
commented 2024-11-12T14:38:55.1533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
17,120
Reputation points Microsoft Vendor
1 answer
How to connect to on-prem Analysis server using synapse notebook and uses System assigned managed identity as authentication.
HI Team, I have an on-prem analysis server details like server name and data base name managed by another team, they have provided access to me on the server but now is it possible to use a synapse notebook to connect to on prem analysis svr. Using…
asked 2024-11-07T19:16:05.7266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(316.8, 71%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EFS%3C/text%3E%3C/svg%3E)
farooq shaik
0
Reputation points
commented 2024-11-12T12:59:03+00:00
Smaran Thoomu
17,120
Reputation points Microsoft Vendor