Share via

dataflow - filter

arkiboys 9,711 Reputation points
2021-12-09T09:10:57.81+00:00

Hi,
I would like to have a filter in the filter transformation inside the dataflow so that I get back if the row has a null orempty my_Date or if the my_Date > today
But I get an error in below expression.
Can you correct it please?
Thank you
isNull(my_Date) or my_Date > currentDate()

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

0 comments No comments

Answer accepted by question author

ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator
2021-12-09T16:24:28.17+00:00

Hi @arkiboys ,

Thank you for posting query in Microsoft Q&A Platform.

I am assuming your "my_Date" Column data type is coming as string. Hence you are ending up with error for expression.

Please consider using your expression as isNull(my_Date) || toDate(my_Date,'MM/dd/yyyy') > currentDate().

Here "my_Date" Column we are converting to Date data type as "currentDate()" function returns results in Date data type only.

If above expression not helps then please share below details to understand issue better and help with resolution.

  • Error details along with screenshot.
  • Data type of "my_Date" column. We can check that under inspect tab of transformation.

Hope this will help. Please let us know if any further queries. Thank you.


Please consider hitting Accept Answer button. Accepted Answers helps community as well.

Was this answer helpful?

1 person found this answer helpful.
0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.