Fatehah L hi there
thanks for posting this on the q&a portal, really appreciate it 8-)
ok so this error "the object has not yet been initialized" in azure data factory when working with sap cdc can be super annoying, especially when it's random like u described )) good job checking with the sap team already. since they see no issues on their side, let's focus on the adf part.
this usually happens when the sap cdc connector in adf tries to access an object before it's fully ready. microsoft docs actually mention this can occur during high load or when the sap system is busy sap cdc connector docs).
retry logic, since reruns eventually work, add a retry policy in ur pipeline. set it to like 3-5 retries with 5 min intervals. this gives sap cdc time to initialize properly. u can do this in the activity's settings under "retry".
throttle requests, if u're loading 100+ objects at once, sap might be overwhelmed. try splitting the load into smaller batches. maybe 20 objects per batch with delays between them. check initialization, before processing, add a lookup activity that verifies the object exists. if it fails, wait and retry. this acts like a "ping" to ensure the object is ready. warmup time, sometimes sap cdc needs extra time after startup. if ur pipeline runs right after adf starts, add a 10-15 min delay at the beginning.
also, make sure ur sap cdc connector version is up to date. microsoft keeps improving these connectors, and newer versions might handle this better %)
if none of this works, u might need to enable deeper logging on both adf and sap sides to catch what's happening during those random failures. Can u pls bring logs and more info according case pls.
Best regards,
Alex
and "yes" if you would follow me at Q&A - personaly thx.
P.S. If my answer help to you, please Accept my answer
PPS That is my Answer and not a Comment