Does ADF copy acitivity allow to format date using polybase.

Question

Does ADF copy acitivity allow to format date using polybase.

Bharat Thatipally 21

I have a bunch of files for which i can use copy activity from azure portal using polybase, but i have a date value coming as string which i am unable to convert to date format.
I have tried other options like data flow task which take more time compared to polybase. Any help in converting incoming string to date using polybase from adf portal?

ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2021-06-17T13:45:11.673+00:00
Hi @Bharat Thatipally ,

Welcome to Microsoft Q&A Portal. Thank you for posting your query.

Could you please share below details in order to provide detailed solution.

What is your Source datastore in Azure? and What is the format of file?

What is your Destination datastore type?
Bharat Thatipally 21 Reputation points

2021-06-17T14:36:00.547+00:00

Hi Maheer, Thank you for responding.

Below are the details.
Source: Azure data lake
file type: csv
Target: synapse table.

let me know for any other details required.

Answer accepted by question author

0 additional answers

Your answer

ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2021-06-17T13:45:11.673+00:00

Hi @Bharat Thatipally ,

Welcome to Microsoft Q&A Portal. Thank you for posting your query.

Could you please share below details in order to provide detailed solution.

What is your Source datastore in Azure? and What is the format of file?

What is your Destination datastore type?
Bharat Thatipally 21 Reputation points

2021-06-17T14:36:00.547+00:00

Hi Maheer, Thank you for responding.

Below are the details.
Source: Azure data lake
file type: csv
Target: synapse table.

let me know for any other details required.

Answer 1

ShaikMaheer-MSFT 38,631 Microsoft Employee Moderator

Hi @Bharat Thatipally ,

Welcome to Microsoft Q&A Platform. Thank you for posting your Query.
To format Date values from source, use Copy activity Mappings tab and select Type as DateTime and define source format in it. Please check below screenshot for same.

Hope this helps.

-----------

Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
Want a reminder to come back and check responses? Here is how to subscribe to a email-notifications.

Bharat Thatipally 21 Reputation points

2021-06-18T19:23:51.843+00:00

@ShaikMaheer-MSFT thank you for the solution provided. it worked.

I have one more query on the same lines.

using the same data copy activity while adding custom columns i want to add a string column (example: 20191231 in YYYYMMDD format) and map it to a date column in Target table.

Here the query is when we add custom columns in the source it is not giving the drop down to select the data type as date time with input format in the mapping tab. ( please let me know if you want me to post this as a separate query.)
ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2021-06-21T06:52:12.413+00:00

Hi @Bharat Thatipally ,

Happy to know that above solution worked for you. Could you please accept above answer so that community will get benefit from it.

Regarding follow up query, Could you please share screenshot of mappings to understand issue better. Feel free to raise new thread if that is okay. Thank you.
Bharat Thatipally 21 Reputation points

2021-06-21T07:09:38.15+00:00

Hi Maheer I have accepted the answer, thank you.. I will be raising a query on with screenshots for the second one.
ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator

2021-06-21T07:45:46.167+00:00

Hi @Bharat Thatipally ,

Thank you for accepting answer.

Share via

Does ADF copy acitivity allow to format date using polybase.

0 additional answers

Your answer