Mapping data flow design question

Question

Hi all-
I am a long time .net developer, doing some adf work. I am trying to design a data flow in which data from an azure sql database table is transformed and inserted into another azure sql database table. If the record is successfully inserted, I want to update the source table with the record id of the target table, and if it fails then i would like to record the error message in an error field on the source table.

I'm having a really hard time writing a question that a search engine can get me to an example that fits my needs. Can anyone point me to some reference material or anything?

thanks all

Answer 1

Hi @lbegatr ,

Thanks for posting the question. The target id can be captured in source after the load by using lookup transformation in dataflow. However, Mapping data flow in ADF currently do not have in-built mechanism to capture error messages dynamically for every row that is copied from source to sink.Custom activity can be used for the same in pipeline if requirement does not need major transformations when copying the data. I checked with Product team and they are working on bringing this feature in mapping data flow, please upvote the idea.

All of the feedback you share in these forums will be monitored and reviewed by the Microsoft engineering teams responsible for building Azure.

Hope this helps. Do let us know if you any further queries.