Dynamic 365 Connector ADF -Incremental Load (Source Tab- Table Option)

Vs2021 46 Reputation points
2021-09-09T23:23:42.207+00:00

Hello All,

It will be of great help if you can answer this :
I am using dynamic365 connector as source to move data into excel files using copy activity

  1. I am forced to use table option instead of query option . I find that if the source table has some rows with null values in a column, the query option does not handle it and doesn't show that column in mapping tab. So I have to use table option to map the columns I need.

Given that scenario, how do I effectively do incremental load from Dynamic365 dataset . I do have a last run date ( Which loads excel files into database).
But I do not know how do I pass that date value with table option in source tab. Can anyone help with this?
I need to run copy activity by passing the date and get only data past that last run date (in table option of Source tab) and then create excel files from it as destination.

If you have resolution for any of the above problems, it will be very much helpful.
Thanks

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,338 questions
{count} votes