Share via

filter and lookup transformation

Vineet S 1,390 Reputation points
2024-05-16T10:11:47.8166667+00:00

Hi,

have 2 tables table1 .jobid 1

table2 tjob2.jobid1 and jobname='test'

how to filter jobid1 where jobname<>'test'

User's image

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.


1 answer

Sort by: Most helpful
  1. AnnuKumari-MSFT 34,566 Reputation points Microsoft Employee Moderator
    2024-05-16T17:27:34.21+00:00

    @Vineet S ,

    Thankyou for posting your query on Microsoft Q&A platform .

    Lookup transformation in dataflow of Azure data factory works similar to left outer join in SQL . All rows from the primary stream will exist in the output stream with additional columns from the lookup stream.

    Could you please share what is the record count for source1 and source2?

    If you want to fetch all records where jobname is not equals to test then kindly use '!='
    User's image

    Also, you can use Join transformation in case you want to perform inner join between the sources

    Hope it helps. Kindly share more information in case you need further assistance. Please mark the answer accepted if it helped. Thankyou

    Was this answer helpful?


Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.