Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,342 questions
ADF Event based trigger not working for ADLS Gen 2 : when a file is manually uploaded or moved via adf pipeline or logic app trigger is working fine but when file is being moved via java code trigger is not working
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 75%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDS%3C/text%3E%3C/svg%3E)
Deepanshi Singh
1
Reputation point
I am using azure data factory where I have configured an event based trigger pointing to ADLS Gen 2 storage. The trigger expects a file to end with Completed-DS001_01.csv ("Blob Path Ends With") in the file location specified in
"Blob Path Begins With".
When a file (having filename as Completed-DS001_01.csv) is manually uploaded or moved via pipeline or logic app to the specified folder location, the trigger is working as expected but when the file having filename
Completed-DS001_01.csv is being placed by some java code (code is written in some different resource) the trigger is not working.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 44%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Saurabh Sharma 23,676 Reputation points Microsoft Employee2021-03-17T21:15:45.243+00:00 @Deepanshi Singh Thanks for using Microsoft Q&A !!
Is your custom code using Azure Data Lake Storage Gen2 REST API ? If yes, can you please verify if your custom code using the CreateFile and FlushWithClose operations that are available in the Azure Data Lake Storage Gen2 REST API ?
If you are writing your own custom logic then we might need to check your code logic.Please refer to the thread
-
Deepanshi Singh 1 Reputation point
2021-03-18T06:26:28.02+00:00 Hi @Saurabh Sharma Thanks for your reply,
I have a script written in java (jdk version 1.8, spring version 2.3.4) and using azcopy (version v10) to move the file to the required trigger location.
-
Saurabh Sharma 23,676 Reputation points Microsoft Employee
2021-03-25T14:12:31.903+00:00 @Deepanshi Singh Thanks for sharing. I am checking on this and get back to you.
-
Saurabh Sharma 23,676 Reputation points Microsoft Employee
2021-03-29T23:48:42.643+00:00 @Deepanshi Singh I have checked internally and at this time you need to create a support case as it requires some debugging sessions. In case you have any limitations creating a support case please send an email to azcommunity[at]microsoft[dot]com with your subscription id with this Q&A thread link and subject as "Attn: Saurabh' and I will help providing a free support ticket for you.
-
Saurabh Sharma 23,676 Reputation points Microsoft Employee
2021-04-02T17:46:53.267+00:00 Hi @Deepanshi Singh ,
I am following up if you are able to create a support case. In case you have any limitations creating a support case please send an email to azcommunity[at]microsoft[dot]com with your subscription id with this Q&A thread link and subject as "Attn: Saurabh'.
Thanks
Saurabh -
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 24%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Shilpi Prasad 0 Reputation points2023-03-21T13:09:07.22+00:00 Hi,
Facing similar issue, any inputs on this?
Sign in to comment