ADF Data Flow Source Empty Recordset

Kengie Ho 1

Hi there,

I notice that in the ADF Data Flow when you are using the Dynamics Dataset as a Source and if the returned recordset is empty. You will get a java.lang.NullPointerException.

Is there a way in the Source of a Data Flow to check for null or catch exception?

If not, can this be proposed as an feature / idea?

Thanks.

ShaikMaheer-MSFT 38,441 Reputation points Microsoft Employee

2022-02-22T13:14:53.557+00:00

Hi @Kengie Ho ,

Thank you for posting query in Microsoft Q&A Platform.

As per my understanding when you are using Source transformation Dataset as Dynamics entity and If that entity returns empty row then you are facing above NullPointerException. Please feel free to correct if my understanding is wrong.

Could you please share exactly when and where you are facing this error? Screenshots with details may be helpful. Thank you.
Kengie Ho 1 Reputation point

2022-02-22T15:40:47.823+00:00

Hi @ShaikMaheer-MSFT ,

That is correct. If the Source transformation is Dynamics and the return entity has no data, the entire Data Flow would fail and return an NullPointerException which in turn also causes the enter Data Flow to fail. As an example i use the 'teammembership' table in the debug settings to grab the data preview.

Please note that the DataFlowParameter is passed to the Dataflow, but you can also put the teammembership as the table to query and the returned data should be empty for the java.lang.NullPointerException to show up.

Attached screenshot:
ShaikMaheer-MSFT 38,441 Reputation points Microsoft Employee

2022-03-08T07:54:57.903+00:00

Usually when our tables doesn't have data we will see no rows under Data preview. Could you please check is that table really exists in your source? Could you please try to create a dataset directly to that table and try to add it in another dataflow and see if data preview works there?
Kengie Ho 1 Reputation point

2022-03-08T14:50:58.113+00:00

Hi @ShaikMaheer-MSFT ,

Yes the table does exists as this is a OOB Dynamics 365 table as shown in the screenshot below:

The problem is any tables that doesn't have any records / rows results an error instead of an empty recordset.

I'm suspecting there is an issue with how the Data Flow Source work.

Thanks.

Share via

ADF Data Flow Source Empty Recordset

Your answer