Share via

filter and lookup transformation

Vineet S 445 Reputation points
2024-05-16T10:11:47.8166667+00:00

Hi,

have 2 tables table1 .jobid 1

table2 tjob2.jobid1 and jobname='test'

how to filter jobid1 where jobname<>'test'

User's image

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. AnnuKumari-MSFT 32,161 Reputation points Microsoft Employee
    2024-05-16T17:27:34.21+00:00

    @Vineet S ,

    Thankyou for posting your query on Microsoft Q&A platform .

    Lookup transformation in dataflow of Azure data factory works similar to left outer join in SQL . All rows from the primary stream will exist in the output stream with additional columns from the lookup stream.

    Could you please share what is the record count for source1 and source2?

    If you want to fetch all records where jobname is not equals to test then kindly use '!='
    User's image

    Also, you can use Join transformation in case you want to perform inner join between the sources

    Hope it helps. Kindly share more information in case you need further assistance. Please mark the answer accepted if it helped. Thankyou