Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,187 questions
2 answers
One of the answers was accepted by the question author.
Azure data factory - query pipeline by data annotations
Is there a way to programmatically query (using .net SDK) list of data factory pipelines by data annotations? I can set data annotation when I run pipeline as explained here, but not sure how to query pipelines or filter pipelines using the same?…
asked 2020-10-23T21:37:28.577+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(25.6, 84%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJV%3C/text%3E%3C/svg%3E)
JAY VORA
21
Reputation points
commented 2020-11-16T23:38:22.617+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT
26,061
Reputation points
1 answer
One of the answers was accepted by the question author.
Azure Data Catalog -Relationship tab
Hi, I have created a Data Catalog (Free version) on my subscription and registered few assets. I know these table have relationships defined and I have registered them all together. However I do not get the relationship tab on the details pane. My last…
asked 2020-11-04T13:28:15.607+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 42%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJH%3C/text%3E%3C/svg%3E)
Janaka Hewavitharana
156
Reputation points
accepted 2020-11-16T23:26:34.59+00:00
Janaka Hewavitharana
156
Reputation points
1 answer
How we can get uptime for all the resources in azure.
Hi guys, I have to check the uptime for the resources in Azure. As for some resources, we can check directly from the Azure portal. I'm able to see uptime for the storage account and SQL database but how can I get the uptime for other resources such…
asked 2020-11-07T07:03:54.573+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 21%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAG%3C/text%3E%3C/svg%3E)
Ashima Gupta
66
Reputation points
commented 2020-11-16T22:45:46.163+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,386
Reputation points Microsoft Employee
0 answers
Expiry Datetime incorrect for Tumbling Window Trigger Catchup Run?
I have a pipeline that primarily has 2 copy activities . The sink for the copy activities is ADLS Gen 1, so it also sets an expiry datetime for each of the files copied over. It uses a tumbling window trigger with a self-dependency. Recently, the…
asked 2020-11-06T19:26:33.123+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(307.2, 36%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERA%3C/text%3E%3C/svg%3E)
Rasika Athavale
1
Reputation point Microsoft Employee
commented 2020-11-16T22:40:37.95+00:00
HimanshuSinha-msft
19,386
Reputation points Microsoft Employee
1 answer
Logs are missing in the Log Analytics Workspace - Azure Data Factory starting 10/23/2020
Hello, Our ADF and the log analytic workspace are hosted under West US2, same as our ADF, and since 10/23, we’ve noticed several pipeline runs do not come with the Succeeded or Failed log, but just InProgress or Queued. It threw off our query since…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 98%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHH%3C/text%3E%3C/svg%3E)
1 answer
Asynchronous execution of statements in stored procedure in Synapse
I have a stored procedure that creates tables and indexes. Is there a way to run these asynchronously inside the stored proc?
asked 2020-11-06T01:22:19.763+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 2%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDK%3C/text%3E%3C/svg%3E)
Deepthi Kodaru
1
Reputation point
commented 2020-11-16T22:26:21.583+00:00
HimanshuSinha-msft
19,386
Reputation points Microsoft Employee
2 answers
Data Factory Loading multiple csv files. Is there any way of dealing with column header differences?
I have csvs in a datalake. Im coping them into SQL using the copy activity the File Path type is a wildcard file path Very occasionally there are slight differences between the column headers. Is there any way that this can be dealt with rather…
asked 2020-11-05T12:56:42.187+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 27%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDE%3C/text%3E%3C/svg%3E)
Debbie Edwards
521
Reputation points
commented 2020-11-16T22:16:54.58+00:00
HimanshuSinha-msft
19,386
Reputation points Microsoft Employee
1 answer
copying data from azure file share to synapse
Hi , I have one requirement like - 1)my users will load some data to azure file share that is mounted on there machine 2) now i want to copy that data from azure file share to container in storage account 3)from that container i want to serve data to…
asked 2020-11-04T07:49:56.757+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 28.000000000000004%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERB%3C/text%3E%3C/svg%3E)
Rohit Boddu
466
Reputation points
commented 2020-11-16T22:08:03.217+00:00
HimanshuSinha-msft
19,386
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
remove user from sphere tenant, company migrated to Office 365
I need to remove a user from Azure Sphere. The user registered using a company email that was assigned to a Microsoft Tenant user. The company has since migrated to Office 365 using Active Directory sync. The existing registered user was removed so…
asked 2020-10-08T22:59:05.507+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 8%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDH%3C/text%3E%3C/svg%3E)
Doug Hardy
31
Reputation points
commented 2020-11-16T22:07:28.763+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 38%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EQ%3C/text%3E%3C/svg%3E)
QuantumCache
20,261
Reputation points
1 answer
Failed to Locate a Column at Position x in the Output Event
Hi all I'm running an export job out of IOTCentral for measurements data and that is going into an Event Hub. I'm then using Stream Analytics to move the data into an Azure SQL table. I've switched on the error tracking in the Stream Analytics log and…
asked 2020-11-02T13:11:27.533+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(124.80000000000001, 62%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJC%3C/text%3E%3C/svg%3E)
John Clifford
21
Reputation points
commented 2020-11-16T22:06:10.853+00:00
HimanshuSinha-msft
19,386
Reputation points Microsoft Employee
1 answer
Ugrading the Azure VM of Window 10 to Visual Studio 2019 VM
Hi We have a bought a windows 10 VM for a fixed price from Azure ( 3 years lock in). My question is that can I delete this VM and create a new VM of Visual studio of same configuration. Does it affect our billing? Current VM Config : …
asked 2020-11-16T06:49:59.57+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 35%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Ankur Shah
1
Reputation point
answered 2020-11-16T21:35:46.62+00:00
whoward-msft
2,766
Reputation points
6 answers
One of the answers was accepted by the question author.
Accessing expired azure student account
I need to access a VM on an expired AZURE Student account, either make it a pay as you go account or access the VM(RDP to download files) to download files any suggestions to make either option happen? I have a new pay as you go account but can't…
asked 2020-11-16T20:55:37.237+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(156.8, 76%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPG%3C/text%3E%3C/svg%3E)
Powell, Gary Anthony
21
Reputation points
commented 2020-11-16T21:34:23.637+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 8%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Anonymous
3 answers
One of the answers was accepted by the question author.
How to create a new StreamingEndpoint for AMS
I'm trying to acces the client.StreamingEndpoints.CreateAsync method that requires resourceGroupName, accountName, streamingEndpointName and paramaeters of type StreamingEndpoint. How do I access this method. I can't seem to figure out how to create a…
asked 2020-11-11T14:28:45.487+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 34%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENS%3C/text%3E%3C/svg%3E)
nbm-Syncronet
191
Reputation points
commented 2020-11-16T21:22:17.177+00:00
Grmacjon-MSFT
17,456
Reputation points
1 answer
One of the answers was accepted by the question author.
Azure ACI for 11 hours everyday
Hi, i have an Azure VM with WINDEV and HFSQL Server which runs for 11 hours per day and 5 days a week. So total 55 hours during week. I am planning to containerize it . Is it good to go for Azure ACI for using 11 hours per day ? Please advise
asked 2020-11-09T10:46:46.023+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(96, 71%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMT%3C/text%3E%3C/svg%3E)
MS Techie
2,691
Reputation points
commented 2020-11-16T20:52:17.567+00:00
whoward-msft
2,766
Reputation points
1 answer
Assign role Storage Contributor to a VM with Java SDK
Hello all, I am currently writing a Java program that creates a VM and wants to download a file from a storage into the VM. Therefore I need to assign access to the VM with role Storage blob data contributor. However, I cannot seem to be able to find how…
asked 2020-11-16T11:43:52.013+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 1%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESV%3C/text%3E%3C/svg%3E)
Stefanova Vesela (IOC/PDL-TQ)
1
Reputation point
answered 2020-11-16T20:29:36.107+00:00
deherman-MSFT
35,636
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
DNS name for virtual machine after Classic to ARM migration.
Greetings. I was asked, from Microsoft Azure, to migrate my server, in Classic resource group, to ARM. My server has only a web service, published and it's used by this url: https://vm-avl-ws5635.cloudapp.net/xxx/yyy/zzz.asmx I'm worried about the…
asked 2020-10-29T19:01:15.07+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 11%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAD%3C/text%3E%3C/svg%3E)
Analisis de Valores Aval Soluciones
21
Reputation points
commented 2020-11-16T18:10:27.563+00:00
TravisCragg-MSFT
5,681
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Getting TlsVersionNotPermitted error when SSIS package executing from ADF
Hi, I have created one SSIS package which is reading data from Storage account and putting that into Azure DB. This is working perfectly well when executing from Visual Studio. But when I am triggering it after deployment in ADF, getting below error. …
asked 2020-11-12T18:01:00.723+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 30%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EV%3C/text%3E%3C/svg%3E)
Vikas
21
Reputation points
commented 2020-11-16T18:10:09.6+00:00
MartinJaffer-MSFT
26,061
Reputation points
1 answer
Azure data disk, sync to on-prem workstation?
Hi, Recently moved a client from on-prem server to an Azure VM 2019. We have site-site VPN established with RemoteAPP setup on the server. We have a set of files about 40GB in size on the server, these files are within a datadisk attached to the…
asked 2020-11-16T02:24:59.367+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 67%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESC%3C/text%3E%3C/svg%3E)
Steven Craighead
1
Reputation point
answered 2020-11-16T17:54:58.34+00:00
deherman-MSFT
35,636
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
Is "Offline Sync" with Azure App Service coming to .NET 5?
My team is looking to build a platform using .NET 5 for most of the components. For the mobile apps, we are pretty set on using Xamarin.Forms (as we have built our current platform using this framework) and it is clear that Microsoft intends to update…
asked 2020-08-28T15:13:15.12+00:00
William Wilson
31
Reputation points
accepted 2020-11-16T17:48:19.737+00:00
William Wilson
31
Reputation points
1 answer
One of the answers was accepted by the question author.
On Premise User Access to Azure Container/Folder
Sorry new to azure,and TechNet forums!(I usually have time to figure things out myself but under pressure at moment!) I have been tasked with sharing an azure container with an on premise user. Its not a file share but a container as their…
asked 2020-11-04T14:49:55.94+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(310.4, 94%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EF%3C/text%3E%3C/svg%3E)
FrankGrimes513
21
Reputation points
accepted 2020-11-16T16:50:32.477+00:00
FrankGrimes513
21
Reputation points