S4 Tables vs sql server table

Rohit Kulkarni 711 Reputation points
2021-10-05T14:32:50.26+00:00

Hello Team,

I am having S4 Tables and extracting the data and loading into SQL Server DB Tables.

In S4 : Table1 we are having 130 Columns and we trying to extract only 110 columns in SQL Server table1.
Similar way there are more than 50 tables and have the same issue and I am using single pipeline with lookup table list. How we can overcome this issue.

Please advise.

Regards
RK

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,148 questions
{count} votes

Accepted answer
  1. ShaikMaheer-MSFT 38,501 Reputation points Microsoft Employee
    2021-10-11T05:45:31.37+00:00

    Hi @Rohit Kulkarni ,

    Thank you for posting query in Microsoft Q&A Platform.

    You can achieve this my having only required columns mapped under mappings tab inside Copy activity.

    But, If you are going to use same copy activity for different files with different schemas, then these mappings should be dynamic. Please check below video where how to dynamically map columns discussed.
    https://www.youtube.com/watch?v=b27gmOufge4

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.