Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,470 questions
Try using binary dataset to copy file as is from source to sink
File size increases when copying data from S3 to Blob using ADF
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 77%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKS%3C/text%3E%3C/svg%3E)
Kaviya Sachi
20
Reputation points
In S3 my file size is 2.3GB and when I copy to blob storage using ADF, my file size changes to 29.15GB.
Not sure why this is happening
{count} votes
-
Nandan Hegde 27,241 Reputation points MVP2023-10-28T03:55:37.59+00:00 Hey, can you please provide your source dataset and sink dataset properties? It seems the source file might be zipped and you might be unzipping it
-
Kaviya Sachi 20 Reputation points
2023-10-30T15:58:03.4166667+00:00 Here are the source and sink details:
Sink:
Source :
-
Kaviya Sachi 20 Reputation points
2023-10-30T16:01:34.94+00:00 Here are Source and Sink details
Source:
Sink:
Sign in to comment
Accepted answer
-
Nandan Hegde 27,241 Reputation points MVP
2023-10-30T16:03:24.7433333+00:00 -
Kaviya Sachi 20 Reputation points
2023-10-30T16:06:36.1466667+00:00 Thanks, let me try that.
-
Nandan Hegde 27,241 Reputation points MVP
2023-11-09T04:21:29.0433333+00:00 Hey @Kaviya Sachi , Did this resolve your issue?
Sign in to comment -