Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,533 questions
How to Unzip Files Without Changing LastModifiedDate
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 11%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAM%3C/text%3E%3C/svg%3E)
Ariel M
51
Reputation points
How do you unzip folders without changing the LastModifiedDate of the files? I have multiple zipped folders. Each folder has 3 files (A.csv, B.csv, and C.csv). Each folder has a different LastModifiedDate.
Add copy task.
Set source to blob folder and set Import Schema to none.
Set the source dataset compression type to ZipDeflate(zip).
Set the sink to a blob folder and set Import Schema to none.
The results unzip the folders but change all the LastModifiedDate to today's date.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 91%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Anil Kumar Raju A 0 Reputation points2023-06-02T03:48:55.9933333+00:00 By default, when unzipping files using Azure Data Factory, the LastModifiedDate of the files will be updated to the current date. However, if you want to preserve the original LastModifiedDate of the files, you can follow these steps:
Create a pipeline in Azure Data Factory.
Add a Copy Data activity to the pipeline.
Configure the Source dataset of the Copy Data activity to point to the zipped folder. Set the Import Schema to "None" and specify the compression type as "ZipDeflate".
Configure the Sink dataset of the Copy Data activity to specify the destination folder where the files will be extracted. Set the Import Schema to "None".
Expand the Mapping settings of the Copy Data activity.
In the Mapping section, ensure that all the required files (A.csv, B.csv, C.csv) are included in the mapping configuration.
Click on the "Settings" tab in the Copy Data activity.
In the "Sink" section, under "Additional settings", add a new property with the name "preserveHierarchy" and set its value to "true". This property ensures that the folder hierarchy is maintained during the extraction process.
Save and publish the pipeline.
When you run the pipeline, the files will be extracted from the zipped folder, and the LastModifiedDate of each file will be preserved, reflecting the original LastModifiedDate from the zipped file.
By using the "preserveHierarchy" property and setting its value to "true", Azure Data Factory will maintain the folder structure and preserve the original LastModifiedDate of the files during the extraction process.
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 12%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESB%3C/text%3E%3C/svg%3E)
Suba Balaji 11,186 Reputation points2023-06-02T07:08:08.7933333+00:00 Hi, do you want to log the last modified date somewhere in log file? Just want to know why you need to maintain it
-
Ariel M 51 Reputation points
2023-06-02T12:11:29.5866667+00:00 Hi Anil Kumar Raju A. How do you require all files (A.csv, B.csv, and C.csv) in the mapping? Should each column from each files be added manually? In the Sink section I added the preserveHierarchy and true value under metadata. I don't see Additional settings. Is this ok?
Hi Subashri Vasudevan. The LastModifiedDate is used to rename the file because the files are named the same in all the folders so they can all be moved to the same folder.
-
Suba Balaji 11,186 Reputation points
2023-06-02T12:45:32.7066667+00:00 Hey, what do you mean by renaming the file? Could you pls elaborate what do you want to do after unzipping.
-
Ariel M 51 Reputation points
2023-06-02T15:06:01.08+00:00 Subashri Vasudevan I know how to rename the files by appending the LastModifiedDate. I just need to be able to unzip the folders without updating the LastModifiedDate.
Anil Kumar Raju A if it would be easier to create a video that would be great thank you.
-
Suba Balaji 11,186 Reputation points
2023-06-02T16:05:07.5666667+00:00 I don't think it's possible to unzip while retaining last modified date. @KranthiPakala-MSFT please check if I'm right here. Thanks
-
Ariel M 51 Reputation points
2023-06-10T11:42:12.8633333+00:00 Anil Kumar Raju A will you please create a video of your initial response?
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee2023-06-19T19:18:14.0666667+00:00 @Ariel M I agree with @Subashri Vasdudevan statement. Currently ADF does not have an out of box feature to retain the last modified date of files being copied/moved. As a workaround you will have to create a custom solution outside of ADF to achieve this.
Below are couple of feature requests regarding the same requirement. Please feel free to up-vote /comment on them to help increase the priority of the requests:
Hope this info helps.
Sign in to comment