Need to pass watermark table value as a parameter in data flow(parameter)

Venkatesh Srinivasan 86 Reputation points
2021-11-18T17:19:18.537+00:00

Hi @HimanshuSinha-msft @KranthiPakala-MSFT @ShaikMaheer-MSFT

I have a requirement where i need to insert the row incrementally if the parameter value is greater than my one of the date column value.

I'm trying to do it in alter row transformation in data flow activity. Bit stuck to fetch the watermark table value from the one of my database table.

Attaching the screenshot of my both flow and pipeline activity. Please help me!

150685-image.png

150697-image.png

150743-image.png

150708-image.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,040 questions
{count} votes

Accepted answer
  1. Nasreen Akter 10,711 Reputation points
    2021-11-18T20:28:18.957+00:00

    Hi @Venkatesh Srinivasan ,

    What I understand from the description is you were trying to pass a value from a LookUpActivity to the DataFlow as a parameter.

    1. In the lookup, if the First row only checkbox is ON, then run the pipeline in a Debug Mode and go to the Pipeline --> Output tab and see the output you are getting from the LookUpActivity.

    150781-image.png
    150699-image.png
    150739-image.png
    150639-image.png

    @activity('Lookup1').output.firstRow.SKU_ADJUSTMENT_DATETIME

    150782-image.png

    If the First row only checkbox is OFF in the LookUpActivity, then you have to do something like @activity('Lookup1').output.value[0].SKU_ADJUSTMENT_DATETIME

    150791-image.png
    150745-image.png
    150718-image.png

    you can also see https://learn.microsoft.com/en-gb/azure/data-factory/control-flow-lookup-activity

    Thanks!

    2 people found this answer helpful.

0 additional answers

Sort by: Most helpful