Invalid date format in ADF

rajanisqldev-42 216 Reputation points
2022-09-09T16:27:38.327+00:00

Hi All,

I need to import data from ADLS to SQL in incremental mode.

I have a config table in SQL and querying this table to get LASTMODIFIEDON using Lookup activity

The datatype in config table is in datetime.
Next step in pipeline is For each loop
In the for each container, I have Dataflow activity.
I have assigned the value @item().lastmodifiedon to dataflow variable defined as timestamp.
I am getting error "parse error in dataflow", if I remove the above assignment, pipeline succeeding.

What am I doing wrong here?

Thanks

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,677 questions
{count} votes

1 answer

Sort by: Most helpful
  1. AnnuKumari-MSFT 32,831 Reputation points Microsoft Employee
    2022-09-10T03:42:11.75+00:00

    Hi @rajanisqldev-42 ,

    Thankyou for using Microsoft Q&A platform and thanks for posting your query.

    For better clarification, could you please confirm if the parameter you created in the dataflow is of date datatype or string datatype. I would recommend you to keep the parameter as string datatype and use toDate() function within dataflow to convert it to date datatype further. Also, while passing the variable to dataflow inside dataflow parameter tab, check the expression checkbox.

    Please let us know if it helps. Thankyou


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.