sink -delta- dateformat -

arkiboys 9,646 Reputation points
2022-04-11T13:21:02.827+00:00

Hello,
At present, the dataflow1 sink has a dataset which stored parquet files in folders based on year/month/day

@markus.bohland@hotmail.de ('folderName/subFolderName', '/year=',formatDateTime(dataset().p_CurrentDate,'yyyy'),'/month=',formatDateTime(dataset().p_CurrentDate,'MM'),'/day=',formatDateTime(dataset().p_CurrentDate,'dd'), '/', dataset().p_VM)

now in dataflow1_new, instead of the sink dataset, I am using inline dataset Delta and in the settings I would like to have the same as above @markus.bohland@hotmail.de but in sink dataflow. It looks like in dataflow, I can not use formatDateTime. How can the above be replaced to be used in dataflow?

Thank you

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,644 questions
0 comments No comments
{count} votes

Accepted answer
  1. KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
    2022-04-12T22:21:38.177+00:00

    Hello @arkiboys ,

    Thanks for the question and using MS Q&A platform.

    My understanding is that you would like to know what is the mapping data flow equivalent expression function to formatDateTime. Please correct me if I'm wrong.

    In mapping data flow expression builder you can use combination of toDate() and toString() functions to format your input date to your desired date format.

    192475-image.png

    For example, if you would like to convert a Date in ( YYYYMMDD) while it’s coming as "2018-10-01T00:00:00" in your source. Then sample expression would look like below:

    toString(toDate('2018-10-01T00:00:00','yyyy-MM-dd'),'yyyyMMdd')  
    

    For samples please refer to this video by @MarkKromer-MSFT - Work with date time expressions in ADF Data Flows

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

0 additional answers

Sort by: Most helpful