Hello @Mona ,
you solution helped quite a bit in the solution.
1) data is like as followed inf flat or csv file:
id pid sdate edate cid
"132","148334" ,"1/2/2018 12:00:00 AM", "32342121"
"1584","148334" ,"1/18/2018 12:00:00 AM", "32347863"
"981","148334" ,"1/2/2018 12:00:00 AM", "32342121"
"1232","153726" ,"1/2/2018 12:00:00 AM", "32347863"
"185","153726" ,"1/2/2018 12:00:00 AM", "32342121"
"6853","123865" ,"2/2/2018 12:00:00 AM", "28383728"
"7563","148334" ,"1/2/2018 12:00:00 AM", "26351735"
I want to load new data, update anything has changed and delete if not exist in source but the one i have is working with conditional split is taking hours to delete about 1M records.
thanks