how to Copy data from synapse database by skipping some coloumns using azure data factory

jessy 21 Reputation points
2021-01-07T05:52:33.187+00:00

Hi Team,

I want to copy table from one synapse database to another and in this i want to skip two coloumns means except these two columns entire table should be copied to target synapse database and i want to this with azure data factory.

is this scenario possible ? and if yes then please tell me how to do this.

Thanks & Regards,
Jezz

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. PRADEEPCHEEKATLA 91,581 Reputation points Moderator
    2021-01-07T09:09:37.31+00:00

    Hello @jessy ,

    You can copy data from the Azure Synapse database by skipping some columns using Azure Data Factory as show below:

    For example, to copy data from one Azure Synapse Database to another and explicitly map your columns as shown:

    On copy activity, => mapping tab, click Import schemas button.

    Map the needed fields and exclude/delete the rest (Select the fields which you want to exclude and click on the delete button).

    54362-image.png

    Azure Synapse Analytics Source table data:

    54312-image.png

    Copy data from synapse database by skipping some columns (PickupTimeID & DropoffTimeID) using azure data factory as shown:

    54313-adf-skipcolumns.gif

    Azure Synapse Analytics Sink table data:

    54381-image.png

    In case, if you want to do it using Azure Data Flows, you may refer similar SO thread addressing the same.

    Hope this helps. Do let us know if you any further queries.

    ------------

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.