Issue while loading data in ADLS GEN2(SINK)/Extracting files from ADLS GEN2(SOURCE)

Question

Issue while loading data in ADLS GEN2(SINK)/Extracting files from ADLS GEN2(SOURCE)

pankaj chaturvedi 81

Hi Team,

I am extracting data from REST API and loading into ADLS and ADLS to SQL DB.

I am encountering the below errors:

activity flow-- copy activity(REST API to ADLS)----->copy activity(ADLS to SQL DB)

step 1- while copying data from rest api to ADLS:

Failure happened on 'Sink' side.

ErrorCode=AdlsGen2OperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ADLS Gen2 operation failed for: Operation returned an invalid status code

'PreconditionFailed'. Account: 'testadl'. FileSystem: 'INPUT. Path: 'input test /YYYY=2020/MM=11/DD=26/customer_test_2020-11-26.json'. ErrorCode: 'LeaseLost'. Message: 'A lease ID was specified, but the lease for the resource has expired.'. RequestId: 'a9a153a7-401f-007f-739e-c4fe17000000'. TimeStamp: 'Fri, 27 Nov 2020 09:18:26

GMT'..,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.Azure.Storage.Data.Models.ErrorSchemaException,Message=Operation returned an invalid status code 'PreconditionFailed',Source=Microsoft.DataTransfer.ClientLibrary,'

step 2- while copying data from ADLS to SQL DB:

Details
Failure happened on 'Source' side. 'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ADLS Gen2 operation failed for: Operation returned an invalid status code **'RequestedRangeNotSatisfiable'. Account: 'testadl'.

FileSystem: 'INPUT'. Path: 'input test /YYYY=2020/MM=11/DD=26/customer_testcase_2020-11-26.json'. ErrorCode: 'InvalidRange'. Message: ****'The range specified is invalid for the current size of the resource.'.** RequestId: 'aa879dc9-e01f-0097-22c1-c403ec000000'. TimeStamp: 'Fri, 27 Nov 2020 13:28:44

GMT'..,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.Azure.Storage.Data.Models.ErrorSchemaException,Message=Operation returned an invalid status code

'RequestedRangeNotSatisfiable',Source=Microsoft.DataTransfer.ClientLibrary,'

I am unable to get why those errors are generating. Could you please someone help out on this.

Thanks,
pankaj

pankaj chaturvedi 81 Reputation points

2020-11-27T15:17:16.483+00:00

Hi Team, Could you please respond here. Thanks!
HarithaMaddi-MSFT 10,081 Reputation points

2020-11-27T15:37:15.26+00:00

Hi @pankaj chaturvedi ,

Welcome to Microsoft Q&A Platform. Thanks for posting the query.

The 'LeaseLost' error seems to be related to outage at ADLS side and further investigation is needed to find root cause of both the errors. Please share data factory name, region and the pipeline run ids that are failing with the above errors and I will work with product team to investigate further.

Looking forward for your response!
pankaj chaturvedi 81 Reputation points

2020-11-27T16:44:32.457+00:00

Hi Haritha,

Thanks for your response.

Sorry, i am unable to share ADF name, it is confidential information

pipeline run ID: b18488fd-477f-45a8-a82a-700b12b3e1d1

region :North Europe

Please let me know if you do find any solution.
HarithaMaddi-MSFT 10,081 Reputation points

2020-11-30T05:46:22.793+00:00

Hi @pankaj chaturvedi ,

Thanks for sharing the run id and region, I will work with our team to investigate further and if we need confidential information, we will connect with you offline. I will update you as soon as I hear from the internal team.

Thanks for your patience!
HarithaMaddi-MSFT 10,081 Reputation points

2020-12-02T07:40:51.533+00:00

Hi @pankaj chaturvedi ,

Thanks for your patience again!

For the "LeaseLost" error message, ADF product team mentioned that it is due to concurrent runs of data factory pipelines on the same source folder or file in ADLS Gen2. Please suggest if the error repeats without running any other pipeline in subscription referring to same source folder.

For the range issue, I am working with ADLS Product team and will get back to you once I hear back from them.

pankaj chaturvedi 81 Reputation points

2020-11-27T15:17:16.483+00:00

Hi Team, Could you please respond here. Thanks!
HarithaMaddi-MSFT 10,081 Reputation points

2020-11-27T15:37:15.26+00:00

Hi @pankaj chaturvedi ,

Welcome to Microsoft Q&A Platform. Thanks for posting the query.

The 'LeaseLost' error seems to be related to outage at ADLS side and further investigation is needed to find root cause of both the errors. Please share data factory name, region and the pipeline run ids that are failing with the above errors and I will work with product team to investigate further.

Looking forward for your response!
pankaj chaturvedi 81 Reputation points

2020-11-27T16:44:32.457+00:00

Hi Haritha,

Thanks for your response.

Sorry, i am unable to share ADF name, it is confidential information

pipeline run ID: b18488fd-477f-45a8-a82a-700b12b3e1d1

region :North Europe

Please let me know if you do find any solution.
HarithaMaddi-MSFT 10,081 Reputation points

2020-11-30T05:46:22.793+00:00

Hi @pankaj chaturvedi ,

Thanks for sharing the run id and region, I will work with our team to investigate further and if we need confidential information, we will connect with you offline. I will update you as soon as I hear from the internal team.

Thanks for your patience!
HarithaMaddi-MSFT 10,081 Reputation points

2020-12-02T07:40:51.533+00:00

Hi @pankaj chaturvedi ,

Thanks for your patience again!

For the "LeaseLost" error message, ADF product team mentioned that it is due to concurrent runs of data factory pipelines on the same source folder or file in ADLS Gen2. Please suggest if the error repeats without running any other pipeline in subscription referring to same source folder.

For the range issue, I am working with ADLS Product team and will get back to you once I hear back from them.

Answer 1

Derome, Eric 11

Hello,
Is this issue resolved ?
We're getting this error which seems the same :
ErrorCode=AdlsGen2OperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ADLS Gen2 operation failed for: Operation returned an invalid status code 'PreconditionFailed'. Account: 'povazudevstoragedatalake'. FileSystem: '01-brute'. Path: 'lnkHoraireChrono/2021/08/26/lnkHoraireChrono_20200402.parquet'. ErrorCode: 'LeaseLost'. Message: 'A lease ID was specified, but the lease for the resource has expired.'. RequestId: 'c04302f3-c01f-0013-6598-9a5bbe000000'. TimeStamp: 'Thu, 26 Aug 2021 16:32:59 GMT'..,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.Azure.Storage.Data.Models.ErrorSchemaException,Message=Operation returned an invalid status code 'PreconditionFailed',Source=Microsoft.DataTransfer.ClientLibrary,'", "failureType": "UserError", "target": "CPD_SQL_HoraireChrono_DL_Raw", "details": [] }

Derome, Eric 11 Reputation points

2021-08-27T16:23:26.337+00:00

The error above : ErrorCode: 'LeaseLost'. Message: 'A lease ID was specified, but the lease for the resource has expired.'. happens in the ForEach loop in a pipeline Activity, in which (inside the ForEach) there is a SELECT FROM in a SQL Server Database and that dataset is going into a parquet file in our Azure DataLake. When the file is being written, that exception seems to happen. What is it with that Lease, is it something the infrastructure manages, because we don't seem to manage it... or have control over it. ??
Anthony Ryan 1 Reputation point

2022-03-18T21:54:50.587+00:00

Same issue here. Google took me here. Still trying to find a solution.

Answer 2

HarithaMaddi-MSFT 10,081

Hi @pankaj chaturvedi ,

We have not received a response from you. Please suggest if the first error due to concurrent runs is resolved. For the second error, product team suggested that RequestedRangeNotSatisfiable indicates the pipeline is trying to access past the length of the file/blob. From this page, If the offset is invalid and exceeds the blob’s total length, the request will return status code 416 (Requested Range Not Satisfiable). Please check the configuration details and let us know if the issue persists.

Thanks for your patience!

---

Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
Want a reminder to come back and check responses? Here is how to subscribe to a notification.

HarithaMaddi-MSFT 10,081 Reputation points

2020-12-09T15:59:09.09+00:00

Hi @pankaj chaturvedi ,

We have not received a response from you. Are you still facing the issue? If you found a solution, would you please share it here with the community? Otherwise, let us know and we will continue to engage with you on the issue.

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members
HarithaMaddi-MSFT 10,081 Reputation points

2020-12-14T15:51:00.327+00:00

Hi @pankaj chaturvedi ,

We still have not heard back from you. Are you still facing the issue? If you found a solution, would you please share it here with the community? Otherwise, let us know and we will continue to engage with you on the issue.

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members

Issue while loading data in ADLS GEN2(SINK)/Extracting files from ADLS GEN2(SOURCE)

2 answers

Activity