convert sting to Date data type in spark sql

Question

AzeemK 516

Whats the best way to convert this string in Date data type in spark sql

20210810 to 08/10/2021

I am keep getting null with T0_Date Function

Martin Cairney 2,261 Reputation points

2021-08-11T07:49:21.563+00:00

Can you clarify which is the Data data type of your two values?

Do you already have one of these as a DATE data type in a data frame?
AzeemK 516 Reputation points

2021-08-12T01:39:22.61+00:00

20210810 is a string , I want to cast to datetime
HimanshuSinha-msft 19,486 Reputation points Microsoft Employee Moderator

2021-08-17T19:26:42.367+00:00

Hello @AzeemK ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu
HimanshuSinha-msft 19,486 Reputation points Microsoft Employee Moderator

2021-08-18T16:29:20.353+00:00

Hello @AzeemK ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu

Accepted answer

0 additional answers

Martin Cairney 2,261 Reputation points

2021-08-11T07:49:21.563+00:00

Can you clarify which is the Data data type of your two values?

Do you already have one of these as a DATE data type in a data frame?
AzeemK 516 Reputation points

2021-08-12T01:39:22.61+00:00

20210810 is a string , I want to cast to datetime
HimanshuSinha-msft 19,486 Reputation points Microsoft Employee Moderator

2021-08-17T19:26:42.367+00:00

Hello @AzeemK ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu
HimanshuSinha-msft 19,486 Reputation points Microsoft Employee Moderator

2021-08-18T16:29:20.353+00:00

Hello @AzeemK ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu

Answer 1

Martin Cairney 2,261

To convert the string "20210810" to a date data type include the date format of the string in the to_date function, e.g:

to_date(col("date"),"yyyyMMdd")