Share via

I am using source as query option in adf data flow.

JIL MODI 0 Reputation points
Apr 19, 2023, 12:18 PM

User's image

In this pipeline, data comes from a lookup, perform for each activity, and inside for each activity data flow activity perform.

In data flow source as dynamic query used. since I am passing a parameter in that value of parameter coming from lookup through for each activity, the query will be dynamic as per below I used - 'select * from dex_in.raw_dexes where operator_global_key =''' + $operator_key + '''' but it still got me an error like this -

Job failed due to reason: com. Microsoft.dataflow.broker.InvalidOperationException: DSL compilation failed: DF-DSL-001 - DSL stream has parsing errors Line 8 Position 91: token recognition error at: '\n' Line 8 Position 94: token recognition error at: '\n'

can you please guide me in this?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,018 questions
{count} votes

1 answer

Sort by: Most helpful
  1. AnnuKumari-MSFT 33,971 Reputation points Microsoft Employee
    Apr 20, 2023, 5:23 PM

    Hi JIL MODI , Welcome to Microsoft Q&A platform and thanks for posting your question here. Based on the description of your query, it seems you are trying to pass the parameter value into dataflow from lookup output dynamically , however, it's throwing syntax error. Please let me know if that is not the case here.

    For such scenario, you need to use escape characters i.e. '' symbol so that it will pass the single quotes in proper format.

    Below video has the implementaiton details for the same requirement: Write dynamic expression for SQL with single quotes around parameter value in Mapping data flows Hope it helps. Kindly accept the answer if it helps. Thankyou.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.