Azure Data Share selective datasets incremental snapshot trigger

Balan Murugan 41 Reputation points
2024-05-17T16:21:44.9866667+00:00

Hi Team,

For a migration project, my source team is using Azure Data Share to share data. Initially, they shared 20 non-PII datasets, but now they plan to add more datasets to the existing Azure Data Share.

When we, as the consumer, trigger an incremental snapshot for selective datasets for the newly added datasets, the Data Share runs for all datasets within the share.

Due to this triggering it for all datasets, my downstream process is getting impacted.

Is there a way for the Azure Data Share consumer to initiate an incremental snapshot only for selective datasets, rather than triggering it for all datasets in the share?

Your assistance is appreciated!

Azure Data Share
Azure Data Share
An Azure service that is used to share data from multiple sources with other organizations.
47 questions
{count} votes

1 answer

Sort by: Most helpful
  1. BhargavaGunnam-MSFT 27,976 Reputation points Microsoft Employee
    2024-05-21T00:51:39.8066667+00:00

    Hello Balan Murugan

    I was able to reproduce the issue from my end. This seems to be a bug as the check mark is enabled to select the incremental or full copy for the selected dataset in the share subscription.

    Alternatively, if this is expected behavior, the checkbox shouldn't be enabled for a single dataset.

    User's image

    If this is expected behavior, I would suggest submitting a feature request.

    Workaround:

    As a workaround, please obtain multiple invitations with the datasets you want to trigger for the snapshot. This way, you can trigger either the full or incremental copy from the respective share subscription.

    I hope this helps unblock your situation.

    Please let me know if you have any further questions.

    User's image

    0 comments No comments