Occassional Issue with passing parameters between activities

Mike Fatal 0 Reputation points
2024-10-31T19:01:41.81+00:00

We are having a spotty issue where once in every few pipeline runs an activity will not fill in the parameters even though we run the same code 50 times and 49 of those times works. There doesn't seem to be any difference that we can find. Has there been a change to the syntax for referencing parameters or is this just a bug within ADF?

Screenshots with details below:

2 pipelines run at the same time with the same code 1 worked 1 failed.User's image

Failed activity did not fill in the parameters and instead passed in the references to those parametersUser's image

Proof the pipeline variables for the pipeline were passed in with values: User's image

Other activity that ran at basically the exact same time that worked as expected with parameters filled in User's image

Code we are using in the activity that is sometimes having issues referencing the parameter valuesUser's image

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,811 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Bhargava-MSFT 31,116 Reputation points Microsoft Employee
    2024-11-01T20:24:59.6+00:00

    Hello Mike Fatal,

    Thank you for sharing the additional information.

    This is indeed an issue with the Snowflake V2 connector. The Snowflake team needs to upgrade the driver version to resolve this issue (a bug on Snowflake’s end). Our product team is working with the Snowflake team to address it.

    We already have an existing backlog item for this issue.

    Meanwhile, as a workaround, you can call the same lookup multiple times and select the "first row" from the result that returns the value.

    Alternatively, continued use of the V1 connector as a workaround.

    I hope this answers your question

    Please let me know if you have any further questions.

    If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.