Error occurs when uploading a large file to BLOB using azcopy

youngsik Ahn 81 Reputation points
2022-12-31T05:57:04.427+00:00

I want to upload a large file to a BLOB using azcopy.

I ran the command like this:

-----------------------

azcopy copy "E:\2022_12_21_125004_6954374.bak" "https://sqlvanxh.......windows.net/dbbak?sp=racwdl&st=..............."

----------------------

However, the following error occurred during execution.

----------------------

INFO: Scanning...
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support

Job 9c1992b8-5450-f542-4679-98aac2152448 has started
Log file is located at: C:\Users\ysahn.azcopy\9c1992b8-5450-f542-4679-98aac2152448.log

  1. 0 %, 0 Done, 1 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 32.7774

Job 9c1992b8-5450-f542-4679-98aac2152448 summary
Elapsed Time (Minutes): 0.1004
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Total Number of Transfers: 1
Number of Transfers Completed: 0
Number of Transfers Failed: 1
Number of Transfers Skipped: 0
TotalBytesTransferred: 0
Final Job Status: Failed

-------------------------------------------

I checked the log file.

-------------------------------------------

-------------------------------------------

2022/12/31 05:45:35 AzcopyVersion 10.16.2 2022/12/31 05:45:35 OS-Environment windows 2022/12/31 05:45:35 OS-Architecture amd64 2022/12/31 05:45:35 Log times are in UTC. Local time is 31 Dec 2022 14:45:35 2022/12/31 05:45:35 ISO 8601 START TIME: to copy files that changed before or after this job started, use the parameter --include-before=2022-12-31T05:45:30Z or --include-after=2022-12-31T05:45:30Z 2022/12/31 05:45:35 Any empty folders will not be processed, because source and/or destination doesn't have full folder support 2022/12/31 05:45:35 Job-Command copy E:.....prod_bak_2021_backup_2022_12_21_125004_6954374.bak https://sqlvanxhpl............2022-12-31t05%3A09%3A26z&sv=2021-06-08 2022/12/31 05:45:35 Number of CPUs: 8 2022/12/31 05:45:35 Max file buffer RAM 4.000 GB 2022/12/31 05:45:35 Max concurrent network operations: 128 (Based on number of CPUs. Set AZCOPY_CONCURRENCY_VALUE environment variable to override) 2022/12/31 05:45:35 Check CPU usage when dynamically tuning concurrency: true (Based on hard-coded default. Set AZCOPY_TUNE_TO_CPU environment variable to true or false override) 2022/12/31 05:45:35 Max concurrent transfer initiation routines: 64 (Based on hard-coded default. Set AZCOPY_CONCURRENT_FILES environment variable to override) 2022/12/31 05:45:35 Max enumeration routines: 16 (Based on hard-coded default. Set AZCOPY_CONCURRENT_SCAN environment variable to override) 2022/12/31 05:45:35 Parallelize getting file properties (file.Stat): false (Based on AZCOPY_PARALLEL_STAT_FILES environment variable) 2022/12/31 05:45:35 Max open files when downloading: 2147483119 (auto-computed) 2022/12/31 05:45:35 Final job part has been created 2022/12/31 05:45:35 JobID=9c1992b8-5450-f542-4679-98aac2152448, credential type: Anonymous 2022/12/31 05:45:35 scheduling JobID=9c1992b8-5450-f542-4679-98aac2152448, Part#=0, Transfer#=0, priority=0 2022/12/31 05:45:35 Final job part has been scheduled 2022/12/31 05:45:35 INFO: [P#0-T#0] has worker 13 which is processing TRANSFER 0 2022/12/31 05:45:35 INFO: [P#0-T#0] Starting transfer: Source "\\?\E:\...........2021_backup_2022_12_21_125004_6954374.bak" Destination "https://sqlva.......9%3A26Z&sig=-REDACTED-&sp=racwdl&spr=https&sr=c&st=2022-12-31T05%3A09%3A26Z&sv=2021-06-08". Specified chunk size 8388608 2022/12/31 05:45:37 PERF: primary performance constraint is Unknown. States: X: 0, O: 0, M: 0, L: 0, R: 0, D: 1, W: 190, F: 0, B: 128, E: 0, T: 319, GRs: 128 2022/12/31 05:45:37 0.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 218.5945 2022/12/31 05:45:39 PERF: primary performance constraint is Unknown. States: X: 0, O: 0, M: 0, L: 0, R: 1, D: 0, W: 257, F: 0, B: 128, E: 0, T: 386, GRs: 128 2022/12/31 05:45:39 0.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 260.2266 2022/12/31 05:45:39 ==> REQUEST/RESPONSE (Try=1/964.6927ms, OpTime=3.7461461s) -- RESPONSE STATUS CODE ERROR PUT https://sqlva.......tYTNjOS0zNTQzLTRkYWYtMjA0YzA0.....&sig=-REDACTED-&sp=racwdl&spr=https&sr=c&st=2022-12-31T05%3A09%3A26Z&sv=2021-06-08&timeout=901 Content-Length: [8388608] User-Agent: [AzCopy/10.16.2 Azure-Storage/0.15 (go1.17.9; Windows_NT)] X-Ms-Client-Request-Id: [5b2388a2-4d10-44f7-4998-ae9cbb6c2a85] X-Ms-Version: [2020-10-02] 

   RESPONSE Status: 400 The specified blob or block content is invalid.

Content-Length: [234]
Content-Type: [application/xml]
Date: [Sat, 31 Dec 2022 05:45:39 GMT]
Server: [Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0]
X-Ms-Client-Request-Id: [5b2388a2-4d10-44f7-4998-ae9cbb6c2a85]
X-Ms-Error-Code: [InvalidBlobOrBlock]
X-Ms-Request-Id: [172d6da5-f01e-0067-64db-1cc1ff000000]
X-Ms-Version: [2020-10-02]
Response Details: <code>InvalidBlobOrBlock</code>

2022/12/31 05:45:39 ERR: [P#0-T#0] UPLOADFAILED: \?\E:\01_..........2022_12_21_125004_6954374.bak : 400 : 400 The specified blob or block content is invalid.. When Staging block. X-Ms-Request-Id: 172d6da5-f01e-0067-64db-1cc1ff000000

Dst: https://sql..........2022_12_21_125004_6954374.bak?se=2023........022-12-31T05%3A09%3A26Z&sv=2021-06-08
2022/12/31 05:45:39 JobID=9c1992b8-5450-f542-4679-98aac2152448, Part#=0, TransfersDone=1 of 1
2022/12/31 05:45:39 all parts of entire Job 9c1992b8-5450-f542-4679-98aac2152448 successfully completed, cancelled or paused
2022/12/31 05:45:39 is part of Job which 1 total number of parts done
2022/12/31 05:45:41 PERF: primary performance constraint is Unknown. States: X: 0, O: 0, M: 0, L: 0, R: 0, D: 0, W: 0, F: 0, B: 0, E: 0, T: 0, GRs: 128
2022/12/31 05:45:41 0.0 %, 0 Done, 1 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 32.7774
2022/12/31 05:45:41

Diagnostic stats:
IOPS: 20
End-to-end ms per request: 3619
Network Errors: 0.00%
Server Busy: 0.00%

Job 9c1992b8-5450-f542-4679-98aac2152448 summary
Elapsed Time (Minutes): 0.1004
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Total Number of Transfers: 1
Number of Transfers Completed: 0
Number of Transfers Failed: 1
Number of Transfers Skipped: 0
TotalBytesTransferred: 0
Final Job Status: Failed

------------------------------------------------

------------------------------------------------

error message

------------------------------------------------

400 The specified blob or block content is invalid.. When Staging block.

------------------------------------------------

Is there a way for me to upload large files?
For reference, a file with a capacity of 1GB was successfully uploaded.

Thanks.

Azure Files
Azure Files
An Azure service that offers file shares in the cloud.
1,170 questions
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,721 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,449 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. JimmySalian-2011 41,921 Reputation points
    2022-12-31T12:20:35.973+00:00

    Hi,

    Can you check the tech blog and steps listed here for similar error 1870350

    Hope this helps.
    JS

    ==
    Please Accept the answer if the information helped you. This will help us and others in the community as well.

    1 person found this answer helpful.