Filter Transformation

Mohamed Mohamed 66 Reputation points
2022-01-16T09:59:08.51+00:00

Can I please post this question again!

In ADF data mapping, I have the column SensitiveRecord with the possibilities (Yes - No - Allow - Null).

I want to filter out the "Yes".

I used the expression SensitiveRecord != "Yes".

The Problem: It only retrieved the "No" rows, while i was expecting "No", "Allow" and Null!

Could you please help where I went wrong! Thanks

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,478 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. svijay-MSFT 5,201 Reputation points Microsoft Employee
    2022-01-17T14:52:50.003+00:00

    Hello @Mohamed Mohamed ,

    Thanks for the question and using MS Q&A platform.

    I had been testing at my end - I did find the Null values were not getting filtered. I used the below expression to handle that as well and it proved working at my end.

    (isNull(SensitiveColumn) || SensitiveColumn != 'Yes')  
    

    Output :

    165745-image.png

    Source :

    165649-image.png

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.