filter and lookup transformation

Vineet S 185 Reputation points
2024-05-16T10:11:47.8166667+00:00

Hi,

have 2 tables table1 .jobid 1

table2 tjob2.jobid1 and jobname='test'

how to filter jobid1 where jobname<>'test'

User's image

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,751 questions
{count} votes

1 answer

Sort by: Most helpful
  1. AnnuKumari-MSFT 31,726 Reputation points Microsoft Employee
    2024-05-16T17:27:34.21+00:00

    @Vineet S ,

    Thankyou for posting your query on Microsoft Q&A platform .

    Lookup transformation in dataflow of Azure data factory works similar to left outer join in SQL . All rows from the primary stream will exist in the output stream with additional columns from the lookup stream.

    Could you please share what is the record count for source1 and source2?

    If you want to fetch all records where jobname is not equals to test then kindly use '!='
    User's image

    Also, you can use Join transformation in case you want to perform inner join between the sources

    Hope it helps. Kindly share more information in case you need further assistance. Please mark the answer accepted if it helped. Thankyou