Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
ADLS blob folder became a file
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 75%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERG%3C/text%3E%3C/svg%3E)
Rascelle Grepo
0
Reputation points
Hi,
Upon running a ADF pipeline, in the data flow, I set it to move files in a folder once the source file has been consumed that folder contained files that have been processed in the past. But after the successful run, I checked the Blob storage and the folder became a file.
How to convert that into a folder again and retrieve what's inside of it. This is my first time encountering this issue, Thanks
Azure Data Lake Storage
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,192 questions
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator2023-04-03T20:00:43.56+00:00 Hello Rascelle Grepo, Welcome to the MS Q&A platform. Please correct me if my understanding is wrong. You are facing an issue where a folder in Azure Blob Storage has turned into a file after running an Azure Data Factory dataflow. Can you please let me know your source dataset here? And what transformations are you using in the data flow, and how are you moving the files from one folder to another? If you can provide more details to help me repro the issue would be great.
-
Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator
2023-04-06T19:34:22.4633333+00:00 Hello Rascelle Grepo I am checking to see if you got a chance to look into my earlier response.
-
Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator
2023-04-10T23:29:25.4366667+00:00 Hello Rascelle Grepo I am checking to see if you got a chance to look into my earlier response.
-
Rascelle Grepo 0 Reputation points
2023-04-20T05:33:20.15+00:00 Hi Bhargava, Apologies for the late response. Source dataset is csv file as well. Transformations are straightforward, like select, filter, union, aggregations, and derived columns. The sink is also csv file. On the source, after completion, it set to move the file to the Archive folder. But it did not move the file, instead after the run, the archive folder became a file itself. I tried to recover all the files inside the Archive folder but seems the soft delete settings was not enabled so I cant' recover anything. Hope you can help me on this. Thank you.
-
Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator
2023-04-21T23:12:11.4533333+00:00 Hello Rascelle Grepo
This seems like a bug.
I was able to reproduce the issue from my end. In the source options, I used the container name 'Input' and inside, there is a folder called 'Input'
After running the pipeline using the dataflow, The file was moved. but I see a new input file(looks like the input folder converted to file) I can still see the input folder.
but my actual file names.csv is no longer available.
I am reaching out to the PG and will get back to you with more updates.
Meanwhile, you can raise a support ticket to recover the files from the backend.
If you need any help with the support request, please let me know.
-
Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator
2023-04-27T21:54:21.9533333+00:00 Hello Rascelle Grepo
I am checking to see if you could submit a ticket to recover the file from the backend.
Sign in to comment
Sign in to answer