Changes(Updates on Data) are appearing on DataFlow Debug level but it is not reflecting to the Databases

Question

Changes(Updates on Data) are appearing on DataFlow Debug level but it is not reflecting to the Databases

Raveendra Vemula 1

There is Dataflow in Azure, where both Update and insert is being happened. When we use the debugger and looked at the results at Dataflow level, Results are seen but After Running the Dataflow using AutoResolveIntegrationRuntime and as well as the Pipeline Trigger. The Update is happening.

Any Inputs on It is appreciated.

AnnuKumari-MSFT 34,566 Reputation points Microsoft Employee Moderator

2022-06-09T09:47:11.943+00:00

Hi @Raveendra Vemula ,
Welcome to Microsoft Q&A platform and thankyou for your question.
As I understand your query, it seems you are trying to perform Upsert using Dataflow , when you view the data preview results, it is giving expected result. However, same is not the case when you run the pipeline calling the dataflow. Please let me know if my understanding is incorrect.

In order to provide better help, would you be able to share the sink settings of your dataflow to check if it is correctly pointing to your desired destination location.
Also, when you say update is not happening in the database, is the pipeline succeeding or failing , kindly share the error if so.

Looking forward to your response. Thanks
Raveendra Vemula 1 Reputation point

2022-06-09T14:59:12.913+00:00

Hi @AnnuKumari-MSFT ,

Thanks for your reply.

Yes, you are right on the understanding. I'm trying to Update the Table if data is already present and insert if not present using Dataflows. The Pipeline is succeeded no errors are popping up. Insertion is being done in proper but Update doesn't work. On the Debug I can the column data is updated as I require but no update on the database.

Attaching the DataFlow Sequence.

Sink Settings Image:

Let me know if you need Additional Information.

Once Again, Thank you!!

Your answer

AnnuKumari-MSFT 34,566 Reputation points Microsoft Employee Moderator

2022-06-09T09:47:11.943+00:00

Hi @Raveendra Vemula ,
Welcome to Microsoft Q&A platform and thankyou for your question.
As I understand your query, it seems you are trying to perform Upsert using Dataflow , when you view the data preview results, it is giving expected result. However, same is not the case when you run the pipeline calling the dataflow. Please let me know if my understanding is incorrect.

In order to provide better help, would you be able to share the sink settings of your dataflow to check if it is correctly pointing to your desired destination location.
Also, when you say update is not happening in the database, is the pipeline succeeding or failing , kindly share the error if so.

Looking forward to your response. Thanks
Raveendra Vemula 1 Reputation point

2022-06-09T14:59:12.913+00:00

Hi @AnnuKumari-MSFT ,

Thanks for your reply.

Yes, you are right on the understanding. I'm trying to Update the Table if data is already present and insert if not present using Dataflows. The Pipeline is succeeded no errors are popping up. Insertion is being done in proper but Update doesn't work. On the Debug I can the column data is updated as I require but no update on the database.

Attaching the DataFlow Sequence.

Sink Settings Image:

Let me know if you need Additional Information.

Once Again, Thank you!!

Share via

Changes(Updates on Data) are appearing on DataFlow Debug level but it is not reflecting to the Databases

Your answer