Handling Salesforce metadata changes in ADF pipeline that has source Salesforce and target SQL Server

Question

How to handle Salesforce metadata changes in ADF pipeline that has source Salesforce and target SQL Server? Metadata changes includes addition of new fields, deletion of existing fields and data type changes in existing fields.

Is there anyway it can be done without manual intervention? I am mainly concerned about addition of new fields because this is more common use case we have.

Answer 1

Hello @Vipin Sharma ,
Thanks for the question and using the MS Q&A platform.

Please correct me if my understanding is wrong. You want to know how to handle metadata changes in adf pipeline with source as salesforce and target as SQL server without manual intervention.

You can use the MetaData-driven copy task explained here to handle metadata changes.

Whenever you need to add new fields(any new metadata changes) you just need to Edit the control table. Once you update the new control table, it will come up with a new SQL script for you. Rerun the SQL script to update your control table.

I found this video is very helpful in explaining the process.

Please let me know if you have any further questions.

---

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators