Dates problem from Oracle to Databricks Parquet insert

Question

Dates problem from Oracle to Databricks Parquet insert

Erkus, John G 1

Hi All

I have created ADF pipelines to move data from Oracle into Databricks - Parquet file
But I am getting the error at below

Failure happened on 'Source' side. ErrorCode=UserErrorUnclassifiedError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Odbc Operation Failed.,Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,''Type=System.ArgumentOutOfRangeException,Message=Year, Month, and Day parameters describe an un-representable DateTime.,Source=mscorlib,'

Please advise

Thanks
Gok

PRADEEPCHEEKATLA 90,646 Reputation points Moderator

2022-07-22T08:30:09.823+00:00

Hello @Erkus, John G ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.
PRADEEPCHEEKATLA 90,646 Reputation points Moderator

2022-08-01T04:01:42.817+00:00
Hello @Erkus, John G ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.

1 answer

Your answer

PRADEEPCHEEKATLA 90,646 Reputation points Moderator

2022-07-22T08:30:09.823+00:00

Hello @Erkus, John G ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.
PRADEEPCHEEKATLA 90,646 Reputation points Moderator

2022-08-01T04:01:42.817+00:00

Hello @Erkus, John G ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.

Answer 1

Hello @Erkus, John G ,

Thanks for the question and using MS Q&A platform.

You may get this error if the datetime column in your oracle view has some dates with negative year in BC like e.g. -0107-12-04. You need to find those records and exclude it while loading the data as ADF does not supports that. Something like below in your WHERE clause could help to identify those rows in your view - WHERE TO_NUMBER(TO_CHAR (<Column Name>, 'sYYYY')) <= 0.

Please try using the setting "Skip incompatible rows" to filter out those records in the copy activity. (See screenshot below).

Share via

Dates problem from Oracle to Databricks Parquet insert

1 answer

Your answer