Facing issue while copy data on adls

Question

Hi Team, I am facing an issue while copy data from MySQL to ADLS and the error is Failure type user configuration issue DetailsErrorCode=UserErrorFailedFileOperation,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The file operation is failed, upload file failed at path: 'etp/CreditNoteTrn/2023/04/CreditNoteTrn_2023-04-10.parquet'.,Source=Microsoft.DataTransfer.Common,' SourcePipelinepipeline1 MonitorCopy activityCopy data1 previously it was working fine but now when i try to execute the pipeline facing an issue. i am giving file path and folder name manually as well. i have also tried browsing the file path, but the result is the same. Please find below screenshots for more details

Answer 1

Hi Lokesh Rajpoot, Thank you for posting query in Microsoft Q&A Platform.

This kind of error may happen if there is incorrect file path or no proper permissions or incorrect authentication method.

Kindly recheck if anything of above not configured properly.
Hope this helps. Please let me know how it goes.

Answer 2

Hi @ShaikMaheer-MSFT thanks for your suggestion but I am executing for more than 5 tables and for all the other tables it's working fine except for one table so it's not an access issue because all the other tables it's working fine. and container name is also the same so there is no issue in the path as well. but found the solution to this error the issue on the source side. Actually, i was using a query in which I have a date-casting statement and there was one row that not satisfied this statement but its raised an error on the sink(ADLS) side instead of the source side. This issue I want to highlight here. below statement I was using in the where clause and source were MS SQL server:- ((DATEDIFF(DAY,convert(varchar,CONVERT (datetime,convert(char(8),CreateDate)),111) ,convert(varchar,CONVERT (datetime,convert(char(8),ExpiryDate)),111)))>92) and the data that was creating problems was ExpiryDate='202300501' Thanks