Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,796 questions
1 answer
One of the answers was accepted by the question author.
SQL Pools missing in the data flows source settings
Hi, I have created a couple dedicated sql pools within the synapse workspace with a view to load data from one poll to the other. However, the sql pools doesn't show in the source type (inline). Can you help please? I wonder if I need to add an extension…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 36%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
3 answers
scheduled trigger should be disabled automatically once activity is done
Hi , I have ADF pipeline inside that I used stored procedure activity and call stored proc. inside SP I checked DTU percentage , if DTU percentage is less than 5% then create index. That pipeline is scheduled every 15 min but once my DTU condition is…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(316.8, 42%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EG%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
ADF: Metadata Activity Output - Order/Sort By option
For the ADF: Metadata Activity Output is there a set order, or an option to Order/Sort By ? I need to FTP XML files source to sink in the order of file name i.e. diff_inventory_2020-12-09_10-15-01.xml diff_inventory_2020-12-09_10-18-01.xml …
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 31%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
ADF Error code 133
In ADF, I am trying to debug a pipeline but all the debug runs are throwing the following error: Error code: 133 Failure type: System error Details: InternalServerError:An error occurred while executing the activity:…
asked 2020-12-08T08:37:31.507+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(208, 78%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKP%3C/text%3E%3C/svg%3E)
Kostas Papadopoulos
101
Reputation points
accepted 2020-12-24T08:45:03.917+00:00
Kostas Papadopoulos
101
Reputation points
1 answer
One of the answers was accepted by the question author.
Azure Datafactory: Getting "Value cannot be null. Parameter name: dictionary" error
I've set up a pipeline in Azure Datafactory that reads a configuration file from a storage account, then runs a different pipeline for each configuration item found. This pipeline ran perfectly last week. Now, however, the pipeline errors out on the…
asked 2020-12-22T06:53:00.63+00:00
Koen van der Pasch
201
Reputation points
accepted 2020-12-24T06:42:36.397+00:00
Koen van der Pasch
201
Reputation points
6 answers
One of the answers was accepted by the question author.
ADF performance troubleshooting
For very basic activities (eg lookup) I'm finding large differences in performance between one execution of a pipeline and the next. For example the following sometimes runs in 3 seconds and other times runs in 20 seconds. What can I do to…
asked 2020-06-15T20:31:45.483+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(70.4, 78%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDB%3C/text%3E%3C/svg%3E)
David Beavon
976
Reputation points
commented 2020-12-24T01:17:26.21+00:00
David Beavon
976
Reputation points
0 answers
Bug in ADF CSV Escaping
I have exported some data from SQL Server into a CSV file (copyData) The actual text is: leading text \"Jane Doe\" trailing text It comes into the CSV file as: "leading text \"Jane Doe\" trailing text" Which fails on input…
asked 2020-12-03T23:01:01.007+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 78%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAP%3C/text%3E%3C/svg%3E)
Alex Peake
1
Reputation point
commented 2020-12-24T01:00:43.28+00:00
Alex Peake
1
Reputation point
1 answer
Amazon MWS - Throttling Limits
Hi Team, I can see direct connector available for "Amazon Marketplace Web Service" with option to select tables. But I couldn't see anywhere about throttling limit to get the data from those tables. But those limits are part of API calls.…
asked 2020-12-16T13:36:24.423+00:00
Mahasubramanian Maharajan
1
Reputation point
commented 2020-12-23T20:21:23.387+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,471
Reputation points Microsoft Employee
2 answers
CopyActivity not utilising high performance
Hi, we are loading data from SQL SERVER to Azure SQLDB I have triggered 4 tables parallel, after some time 3 tables loaded and 4th table is still running which have more records and at the same time, some tables loaded quickly with high…
asked 2020-12-08T09:39:07.123+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 54%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETG%3C/text%3E%3C/svg%3E)
THIMMAIAH GARI,PRASHANTH,,
201
Reputation points
commented 2020-12-23T19:42:55.507+00:00
HimanshuSinha-msft
19,471
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
How to configuring timings in trigger to run pipeline twice in a day
Hi All, I have a requirement to run a pipeline twice in a day at 8:15 AM UTC and 9:45 AM UTC. How to proceed with this scenario?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 27%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPJ%3C/text%3E%3C/svg%3E)
0 answers
copy high volume on prem data to blob
Hi , I am copying data from on prem db Netezza to azure blob storage using ADF copy. But few of the on prem tables are having huge data like 1 trillion rows. Can you please advice the best way to approach for this high volume of data to copy into…
asked 2020-12-22T07:05:04.63+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 8%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGS%3C/text%3E%3C/svg%3E)
Gowri Shankar
226
Reputation points
commented 2020-12-23T04:28:28.823+00:00
PRADEEPCHEEKATLA-MSFT
87,731
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
Connect from local SQL database inot Azure Data Factory
Hi. How can I connect a local SQL database into a Azure Data Factory? In my project, It is necessary to have the updated data in Azure storage, once a day. Does Copy Moduel in Data Factory work in this case? Or is it just an offline action (one…
asked 2020-12-22T15:13:28.52+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 4%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERL%3C/text%3E%3C/svg%3E)
Ørjan Lønning
21
Reputation points
answered 2020-12-23T03:11:29.407+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 78%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECZ%3C/text%3E%3C/svg%3E)
Cris Zhan-MSFT
6,626
Reputation points
1 answer
One of the answers was accepted by the question author.
Using a Variable in a Web Activity Body? URGENT PLS
Hello! I have the following as part of my ADF Web Activity Body. My question is, can I do this? "XRefCode": "@variables('Payclass')" "XRefCode": "@{item().employeeType}", "ShortName":…
asked 2020-12-19T04:36:00.91+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 49%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMK%3C/text%3E%3C/svg%3E)
Mike Kiser
1,536
Reputation points
commented 2020-12-22T23:30:59.397+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT
26,076
Reputation points
0 answers
SHIR Registration in Gov Cloud
I'm attempting to deploy a SHIR via on-prem VMWare VM to connect to an ADF instance in USGovTX region (Gov cloud) During the registration process I'm receiveing the following error in Event Log after clicking "Finish" …
asked 2020-12-16T14:26:38.523+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 21%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJF%3C/text%3E%3C/svg%3E)
Josh Fennessy
26
Reputation points
commented 2020-12-22T22:18:18.97+00:00
MartinJaffer-MSFT
26,076
Reputation points
2 answers
One of the answers was accepted by the question author.
ADF reading json array of documents in Data flow
Hi, In Data flow object I'd like to read data from json files from blob storage (created in a separate pipeline), but when I try to click "Import projection" in "Projection" the result is only one column _corrupt_record: …
asked 2020-12-16T08:31:17.843+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(41.6, 43%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJR%3C/text%3E%3C/svg%3E)
Jakub Ramut
96
Reputation points
accepted 2020-12-22T12:18:23.807+00:00
Jakub Ramut
96
Reputation points
1 answer
How to query 3rd party Azure DataLake Gen2 and only store the results
First, what I am trying to do is I want to query and aggregate raw JSON files stored in a 3rd party's Azure Data Lake (Gen2) and store those aggregates in my own data lake or relation db. I do not want to physically copy all of those raw JSON files…
asked 2020-12-15T16:14:02.687+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 56.00000000000001%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ5%3C/text%3E%3C/svg%3E)
JasonW-5564
161
Reputation points
commented 2020-12-22T12:18:09.123+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 9%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HarithaMaddi-MSFT
10,136
Reputation points
1 answer
Linkedin connectivity with Azure
Hi, Is there a way to extract existing content from a Linkedin company page using Azure? Thanks
asked 2020-12-16T07:47:10.393+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 59%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDR%3C/text%3E%3C/svg%3E)
Darshika Rajendran
1
Reputation point
commented 2020-12-22T12:17:25.62+00:00
HarithaMaddi-MSFT
10,136
Reputation points
1 answer
One of the answers was accepted by the question author.
Resume Azure Data Base from Azure Factory pipeline
Hi, I have an Azure data base which gets paused automatically after 1 hour. I am using this database as a dataset in my Azure data factory pipeline. I have a source inside a data flow which gets failed because my database is in paused state. I do not…
asked 2020-12-18T13:13:26.623+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 83%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMJ%3C/text%3E%3C/svg%3E)
Manish Jain
31
Reputation points
accepted 2020-12-22T09:30:52.51+00:00
Manish Jain
31
Reputation points
1 answer
One of the answers was accepted by the question author.
Error when Object Type parameter is passed through another pipeline
Hi All, I have a pipeline with object type parameter that is used to parameterize Additional columns property in Copy activity. The value of the object parameter is:…
0 answers
ADF @concat giving extra brackets and \....why? Please Help
HI! All I am trying to do is in a VARIABLE concat the fixed url string value with the employee number and I am getting these brackets and backslashes as shown. the employee number is an array that I'm using an ForEach Activity. Any idea why I am getting…
asked 2020-12-09T18:06:01.603+00:00
Mike Kiser
1,536
Reputation points
commented 2020-12-22T00:44:34.527+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 44%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Saurabh Sharma
23,796
Reputation points Microsoft Employee