Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,207 questions
1 answer
One of the answers was accepted by the question author.
फोनपे का शिकायत कैसे करें? 9301792255
फोन पे पैसे कट जाए तो क्या करें ऐसी स्थिति में गूगल पे पेमेंट प्लेटफॉर्म ((9301-792-255)फोन पे (Phone Pay), पेटीएम यूपीआई ( के कस्टमर केयर पर कॉल करें: 24 ÷7/ट्रांजेक्शन डिटेल शेयर करके कंप्लेन दर्ज करें.....
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 56.00000000000001%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAD%3C/text%3E%3C/svg%3E)
0 answers
Azure Data Factory, Data Flow shows "Columns 0 Total" but preview has data
I have a table that gets inserted every night (600 rows), I then reference that table in order to do a Data Flow call "Delete Duplicates". However, when I reference that table; it shows Columns: 0 Total. But if I go to the "Data…
asked 2024-07-29T20:00:24.69+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 17%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGB%3C/text%3E%3C/svg%3E)
Grant Bertoli
0
Reputation points
asked 2024-07-29T20:00:24.69+00:00
Grant Bertoli
0
Reputation points
0 answers
Unable to View Scheduled Certification Exam in Dashboard
I'm experiencing issues with my Microsoft Certification account and exam visibility: Email Change: My account is linked to a former employer's email address. How can I update this to my personal email? Exam Visibility: I have an upcoming certification…
asked 2024-07-29T18:52:37.68+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(150.4, 71%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDG%3C/text%3E%3C/svg%3E)
David Godin
0
Reputation points
asked 2024-07-29T18:52:37.68+00:00
David Godin
0
Reputation points
1 answer
How to improve Copy Data runtime on Azure Data Factory
Hi, I'm copying data from Amazon S3 to Azure Data Lake Storage Gen2. The source contains mutliple parquet files with same schema and the target is a single parquet file that should contain the merged inforamtion from my source, so I set the copy…
asked 2024-07-26T21:03:14.7266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(25.6, 50%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVZ%3C/text%3E%3C/svg%3E)
Violet Zeng
30
Reputation points
commented 2024-07-29T18:02:38.5366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 46%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EN%3C/text%3E%3C/svg%3E)
NIKHILANETHIKUNTA
155
Reputation points Microsoft Vendor
1 answer
Wrong URL encoding in Data Flow leading to illegal character error in query
Hi, I have a REST API dataset. The official APIs (https://me.sap.com/notes/3463893) require relative URLs with white spaces, for example: DATA_COLLECTION?$filter=DC_PARAMETER_NAME eq 'TAGGY_SN' In this case, I have encountered misleading behavior: …
asked 2024-07-24T15:59:26.0666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 88%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVS%3C/text%3E%3C/svg%3E)
VINCENZO SALVO
5
Reputation points
commented 2024-07-29T17:51:42.6033333+00:00
NIKHILANETHIKUNTA
155
Reputation points Microsoft Vendor
2 answers
No Linkage between Azure Data Factory and Snowflake Error Outputs
There is no linkage between Azure Data Factory and Snowflake currently during times when any script activity fails, it gives us an error. But what would really help us is if we can fetch the failed query id from snowflake, it would really save us a lot…
asked 2024-07-18T13:25:37.9133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 59%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Swapnil Sarkar
0
Reputation points
answered 2024-07-29T17:50:06.87+00:00
NIKHILANETHIKUNTA
155
Reputation points Microsoft Vendor
2 answers
ADF Copy Activity - Emply col issue
Hi Team, I have a pipeline where I am copying the data from the file to a database. The file had one extra empty column in between, and my copy activity failed with the below error: Message: Invalid Excel header with empty value It failed because the…
asked 2024-07-20T02:14:27.9266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(96, 24%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
ADF_Coder
0
Reputation points
commented 2024-07-29T17:16:40.8233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
555
Reputation points Microsoft Vendor
2 answers
Schedule a pipeline in Azure Synapse analytics
How can I schedule a trigger pipeline in Azure Synapse analytics to run every 30 minutes, but avoid starting when another pipeline is running or at certain specified times (such as between 1 am to 3 am)? I am seeking guidance on the best approach for…
asked 2024-07-24T07:33:29.9833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 69%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Aditya Singh
105
Reputation points
edited an answer 2024-07-29T17:10:44.1866667+00:00
Chandra Boorla
555
Reputation points Microsoft Vendor
0 answers
How add Integer query param to a Rest Api Dynamically in Azure Data Factory Copy Activity
Hi, I have to make api calls to fetch data of multiple ids , The api accept the ids in the integer format . I am using foreach and copy data activity to get the data from the Rest api, to dynamically include these integer ids how can I concatenate it…
asked 2024-07-29T16:10:11.6233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 76%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESR%3C/text%3E%3C/svg%3E)
Sadafule, Ranjith Kumar
0
Reputation points
asked 2024-07-29T16:10:11.6233333+00:00
Sadafule, Ranjith Kumar
0
Reputation points
0 answers
Parameterizing ADF Reference Names in ADF Pipeline JSON
Hi Team, We are trying to Parameterize the pipeline Json file with parameters and variables making it more generic in Azure Data Factory Pipelines without any hardcoding's. Except below reference name where Azure data factory objects are being used like…
asked 2024-07-29T15:17:46.1766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 93%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MADESHWARAN, MANOJ
0
Reputation points
asked 2024-07-29T15:17:46.1766667+00:00
MADESHWARAN, MANOJ
0
Reputation points
2 answers
Connect Google drive to Azure without GCP and without creating a copy
Hello I was just wondering if there's a way to use sort of virtualized data transfer instead of creating a copy of the data on Azure. As far as I understand all explained ways include creating a copy of the file and moving to Azure to index it. Is there…
asked 2024-07-25T08:03:41.71+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 43%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETM%3C/text%3E%3C/svg%3E)
Tony Minozi
20
Reputation points
answered 2024-07-29T14:36:27.85+00:00
Chandra Boorla
555
Reputation points Microsoft Vendor
1 answer
self-hosted Integration runtime datafactory copy fails: The underlying connection was closed: Could not establish trust relationship for the SSL/TLS secure channel.
In datafactory we have a step to copy data from the on-premises oracle database to azure blob storage (private endpoint) with a self-hosted integration runtime. This self-hosted integration runtime has access to the blob storage. But the copy steps…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 1%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EY%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
How can I move a file from one folder to another?
I am using ADF to process data that is dropped on to a container/folder. Once the file is available ADF will consume it and load it to a SQL Table using Copy activity. At the end of pipeline run, I need to move that file to a different container…
asked 2021-03-18T19:47:34.947+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 20%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBK%3C/text%3E%3C/svg%3E)
Balachandran Kannan
181
Reputation points
edited a comment 2024-07-29T13:38:00.1466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(105.60000000000001, 16%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHP%3C/text%3E%3C/svg%3E)
Hrithik Purwar
0
Reputation points
4 answers
One of the answers was accepted by the question author.
Error column operands are not allowed in literal expressions adf
i am getting this error Column operands are not allowed in literal expressions. How can i append an expressions with string in dynamic query while creating a source dataset in dataflow.
asked 2021-06-16T15:54:50.463+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 48%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAR%3C/text%3E%3C/svg%3E)
Aditya Raj
286
Reputation points
commented 2024-07-29T13:28:06.55+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 52%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smit, TK (Tim)
0
Reputation points
1 answer
Azure Data Factory obtaining Token via web activity
My requirement: Within Azure Data Factory I want to be able to use msgraph to enumerate a list of users that all belong to a specific department and upload this list to an SFTP server. I have already added the SFTP server as a linked service…
asked 2024-07-24T15:57:46.9333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 2%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA0%3C/text%3E%3C/svg%3E)
azure-000
1
Reputation point
commented 2024-07-29T13:18:49.1433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
12,620
Reputation points Microsoft Vendor
1 answer
HELP how to fix "Message": "Failure happened on 'Source' side. 'Type=Npgsql.PostgresException,Message=42601: syntax error at or near \"FROMpublic\"\r\n\r\nPOSITION: 10,Source=Npgsql,'"
I created a ADF pipeline to ingest my tables in bulk to azure data lake storage from my postgres database . However while running the pipeline threw me an error : "Message": "Failure happened on 'Source' side.…
asked 2024-07-28T14:50:19.3366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(112.00000000000001, 39%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EC%3C/text%3E%3C/svg%3E)
Chris
0
Reputation points
edited an answer 2024-07-29T12:52:57.9666667+00:00
Pinaki Ghatak
3,265
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Azure Data Factory Data Flow activities stuck in queued status before starting to aquire computing
Hi, I have a pipeline that runs a Dataflow activity, and it was working fine but since 3 days ago, the Dataflow activity started being stuck in queued state for like 5 minutes before it starts aquiring computing resources then running, the total time now…
asked 2024-07-24T15:46:17.7933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 97%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAE%3C/text%3E%3C/svg%3E)
Ala-eddine Zerguine
20
Reputation points
accepted 2024-07-29T12:49:08.2533333+00:00
Ala-eddine Zerguine
20
Reputation points
1 answer
When can we have the new version of Snowflake connector with the problem solved about error message in script activity using the new Snowflake connector?
Hi, I'd like to know when can we have a new version of Snowflake connector for ADF : https://learn.microsoft.com/en-us/answers/questions/1660189/how-to-pass-error-details-from-snowflake-stored-pr?source=docs
asked 2024-07-18T06:52:42.64+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 95%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EFB%3C/text%3E%3C/svg%3E)
FERNANDO BASAEZ
0
Reputation points
answered 2024-07-29T12:14:01.8433333+00:00
Smaran Thoomu
12,620
Reputation points Microsoft Vendor
2 answers
How to copy data from a large SharePoint Online list in Azure Data Factory (ADF)?
I am having trouble copying data from a large SharePoint Online list that has many records and columns in Azure Data Factory. I am unable to preview or copy the data, and I'm not sure if the issue is with the size of the list or the column types. I've…
asked 2024-07-26T00:58:24.41+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 84%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
asnth
0
Reputation points
commented 2024-07-29T12:13:16.63+00:00
NIKHILANETHIKUNTA
155
Reputation points Microsoft Vendor
1 answer
Error "Cannot read properties of undefined (reading '0')"
I'm using Azure Data Factory online via a browser. I'm fairly new to ADF and have yet to complete any ADF tutorial due to various problems I've encountered. I'm doing a tutorial on ADF from Udemy. I'm running a pipeline to copy data from a…
asked 2024-07-26T10:25:18.1033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(294.40000000000003, 77%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECR%3C/text%3E%3C/svg%3E)
Chuck Roberts
65
Reputation points
commented 2024-07-29T12:08:15.56+00:00
Chandra Boorla
555
Reputation points Microsoft Vendor