It's one and the same I'd say... just because it's created within the synapse setup doesn't mean it's a separate app to the storage
synapse pipeline - blob storage
Hello,
The synapse pipelines transfer files into the blob storage as we select the sink as the blob storage folders.
Question:
I know when we created the synapse environment, the data lake storage Gen2 was created by default in the workspace.
Question:
Why is it when files are transferred to the blob storage, then they also can be seen in the storage Gen2 as well?
Is there a relationship between the blob storage and the datalake storage Gen2 ?
Thank you
4 answers
Sort by: Most helpful
-
-
arkiboys 9,691 Reputation points
2021-07-28T06:24:05.06+00:00 So does this mean there is no need to create Azure blob storage and just use the default storage Gen2 ?
-
MartinJaffer-MSFT 26,086 Reputation points
2021-08-03T17:44:32.713+00:00 Hello @arkiboys . If you are not aware, Data Lake Gen 2, is an enhanced version of Azure Storage. Data Lake Gen2 is blob storage with Heirarchical Namespace enabled.
This said, do not mix the two connectors. Both can be used to read from the same storage account, but only one deals with folders/directories.
If your storage is a Data Lake Gen 2, only use the Data Lake Gen 2 method for writing.Does this make sense?
-
arkiboys 9,691 Reputation points
2021-08-04T06:46:33.277+00:00 Hi,
I still do not see the difference between the two.
Our synapse pipelines place data into .parquet files inside the Azure blob storage folders...
I see that the same folder structures and .parquet files are also added into the storage Gen2 automatically.Why is this happening automatically and do I need to use the blob storage?
Thank you