Validation failed while upgrading Azure blob to datalake gen 2

Amar Agnihotri 926 Reputation points
2022-05-11T15:20:00.37+00:00

Hi @Pratik Somaiya , @Nandan Hegde ,
I am upgrading Azure blob storage to DataLake gen 2. I have already created few pipelines in adf in which there was a delete activity with logging enabled and i have given a path to a blob container for the logged files. Now when i tried to upgrade to datalake gen 2 validation got failed saying that "Incompatible feature soft delete". Now i disabled "Ënable Logging' in all the adf pipeline even i removed the path of the blob folder and deleted that folder from blob storage as well but still i am getting this validation failed message. I am not able to get that what changes are still needed. see the error -

201069-image.png

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,192 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,624 questions
0 comments No comments
{count} votes

Accepted answer
  1. Nandan Hegde 36,146 Reputation points MVP Volunteer Moderator
    2022-05-11T17:18:28.283+00:00

    Hey,
    Based on the error message, you might need to disable the soft delete feature.
    To disable container soft delete for your storage account by using Azure portal, follow these steps:

    In the Azure portal, navigate to your storage account.

    Locate the Data protection settings under Data management.

    Uncheck soft delete for containers.

    Post that try upgrading! Hope this should help.

    1 person found this answer helpful.

1 additional answer

Sort by: Most helpful
  1. Amar Agnihotri 926 Reputation points
    2022-05-12T09:35:17.873+00:00

    hi @Nandan Hegde ,
    The issue has been resolved sometimes it took almost 24 hrs to delete all the meta data even after disabling the soft delete. So i just copied all the files creating issues to the new storage account and then deleted those files from the original storage account. Then i tried to upgrade it and it successfully upgraded to datalake. I did this because i didn't have time to wait for 24 hours . But finally the issue is resolved. Thanks for your support and quick reply. See you soon


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.