Mapping data flow does not load any rows to 1 out of 2 branches

Cedersved 16

I have this mapping data flow, with two branches from 'RemoveHdlColumns'.
When I run this the rows from MergingInput is only loaded through the bottom branch.
All the rows are loaded for the 'Select2' transformation, but NO rows hits the 'Select1' transformation (or HashAllColumns or ChangedRows).
Select1 and Select2 are identical, without any expression - just set to auto mapping.

Why is this?

Cedersved 16 Reputation points

2020-06-04T07:33:35.957+00:00

Here's a revised version where i duplicated the 'MerginInput' source. I also added a new, unnecessary sink to the top branch - which makes the output with the row counts a bit more clear. But I don't understand the monitor view of data flows. In the attached picture, I get no row count for the 'EstablishRowHashMetadata' transformation. Not in the bottom view of the flows to the sink, and not in the right pane if I click the transformation. It makes it seem that no rows were passed to this transformation. But appearantly it processed rows, as the stream for EstablishRowHashMetadata was used to identify the 2 rows in the ChangedRows exist transformation.
MartinJaffer-MSFT 26,096 Reputation points

2020-06-08T16:53:39.7+00:00

@Cedersved Thank you for bringing this issue to our attention. I have a question. Is the Data Flow writing the output your expect, and this is just a problem with the reporting. Or, is the Data Flow not working properly and giving you bad output?
Cedersved 16 Reputation points

2020-06-09T05:11:00.843+00:00

@majaffer It is not giving the output I expected. I did not get any rows in the sink with the currentUTC set in the CreateValidFrom transformation. So the reporting seemed to true from the perspective of no rows being passed beyond the Join1 transformation. Join1 inner joins the source (RemoveHdlColumns or Select2) with the output of ChangedRows using the same expression to generate a hash column as in the HashAllColumns transformation (generating a md5 hash using byPosition for the first 100 columns).
MartinJaffer-MSFT 26,096 Reputation points

2020-06-23T20:54:28.01+00:00

My apologies for being unable to help. If you are still facing the issue, I can offer you a 1 time free support ticket.

For a deeper investigation and immediate assistance on this issue, if you have a support plan you may file a support ticket, else could you please send an email to azcommunity@microsoft.com with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter.
Thread URL:
Subscription ID:
Subject : Attn majaffer
Please let me know once you have done the same

Thanks

Share via

Mapping data flow does not load any rows to 1 out of 2 branches

Your answer