Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory Copy on blob not preserving content properties
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 91%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMC%3C/text%3E%3C/svg%3E)
Matthew Campbell
11
Reputation points
See original question on Stack Overflow:
https://stackoverflow.com/questions/75531644/copy-activity-blob-preserve-metadata?noredirect=1#comment133278306_75531644
The built-in system properties governing content are not being preserved:
https://learn.microsoft.com/en-us/azure/data-factory/copy-activity-preserve-metadata#preserve-metadata
Likely why the metadata is not preserved as should be with binary data. Default behavior with azcopy is to keep metadata and properties. Little weird the deviation with Azure Data Factory to not preserve by default.
Azure Data Factory
{count} votes
-
Matthew Campbell 11 Reputation points
2023-03-06T11:31:59.22+00:00 Would be great if the Copy activity is a really just a pipeline (of REST calls etc) to see a reference.
-
Matthew Campbell 11 Reputation points
2023-03-06T11:32:00.3533333+00:00 Would be great if the Copy activity is a really just a pipeline (of REST calls etc) to see a reference.
-
Matthew Campbell 11 Reputation points
2023-03-06T11:32:01.33+00:00 Would be great if the Copy activity is a really just a pipeline (of REST calls etc) to see a reference.
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
HimanshuSinha 19,547 Reputation points Microsoft Employee Moderator2023-03-07T20:50:40.8+00:00 Hello @Matthew Campbell , Thanks for the question and using MS Q&A platform.
Just to be sure that we understand the ask here. As I understand the below is one of the ask.
- By default, while copying binary data using Copy activity, the default behavior should be to save the metadata , currently its not .
Please feel free to correct me .
- Also you mentioned
Would be great if the Copy activity is a really just a pipeline (of REST calls etc) to see a reference.Can you please clarify a bit more on this please?
Thanks Himanshu
- By default, while copying binary data using Copy activity, the default behavior should be to save the metadata , currently its not .
-
Matthew Campbell 11 Reputation points
2023-03-08T08:09:44.5333333+00:00 That part of the GUI doesn't exist in the version of Azure Data Factory I am using. See picture below. The preserve attribute has been manually added to the activity's JSON instead without result.
Ignore question 2. The Data Factory isn't in the public domain (i.e. via git). More frustration that many of the pre-defined activities don't behave as expected or have irritating caveats (like when copying from Azure Search the array properties are preserved).
Anyway. Something is off. Can start with how Perserve is visibel in one GUI but not another. Version? A preview perhaps?
-
HimanshuSinha 19,547 Reputation points Microsoft Employee Moderator
2023-04-11T19:23:49.6366667+00:00 Hello @Matthew Campbell , Thanks for the patience , unfortunately we are not getting the kind of response from the team here . if you have a support plan you may file a support ticket, else could you please send an email to azcommunity@microsoft.com with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter. Subscription ID:Subject : Attn Himanshu
Please let me know once you have done the same.Thanks Himanshu
Sign in to comment
Sign in to answer