Azure Data Flow - Sink Block

Saminath, Nikesh 0 Reputation points
2023-11-13T11:24:04.7533333+00:00

Hi Guys,

I am trying to remove null rows before sinking the output to a csv. Everything works fine however I do not see the "Update method" options on the sink block of the data flow. Any advice will be appreciated.User's image

Thanks.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,581 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Amira Bedhiafi 23,251 Reputation points
    2023-11-13T12:01:22.09+00:00

    I don't understand exactly your request, if you are looking for something related to upsert check this thread

    For dealing with NULL values I recommend :

    • Use the “if” and “else” conditions in subsequent activities to check for null values in the output of the previous activity. If a null value is encountered, you can choose to skip the activity or provide a default value.
    • Use the coalesce function to replace any null values with a default value. The coalesce function returns the first non-null value in a list of expressions, allowing you to provide a default value if the original value is null.
    • Use the null function to test for null values in the activity output. The null function returns a Boolean value indicating whether the specified expression is null, allowing you to branch the pipeline based on whether the output is null or not.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.