How to run curl command for Azure REST API with comp=range

Question

How to run curl command for Azure REST API with comp=range

Nguyen Thien 0

Curl command: curl -i -X PUT "https://zzzstorage.blob.core.windows.net:443/test2/observation/test.json?comp=range&<SAS token" -H "Content-Length: 183999" -H "x-ms-range: bytes=0-183998" -H "x-ms-date: Wed, 14 Jun 2023 18:49:0 GMT" -H "x-ms-write: update" --data test.json

KarishmaTiwari-MSFT 20,772 Reputation points Microsoft Employee Moderator

2023-06-15T16:04:16.0033333+00:00

@Nguyen Thien Can you please elaborate on your scenario - what are you trying to do, which Azure service is it related to and what's the end goal.

Also, share the documentation url that you are following to achieve this, if any. This would help me to reproduce the issue on my end and troubleshoot.

What issues are you seeing with the command shared? Let me know. Thanks.
Nguyen Thien 0 Reputation points

2023-06-15T16:36:53.3566667+00:00

Hi @KarishmaTiwari-MSFT the end goal is to upload a file from my linux VM to my Azure storage container "test2", in the folder observation manually. First I sent an HTTPS PUT request to upload an empty file (create-file: https://learn.microsoft.com/en-us/rest/api/storageservices/create-file):

$ curl -i -X PUT "https://storage1657.blob.core.windows.net:443/test2/observation/test-1-min-obs-2023-02-28-144253.json?<SAS key>" -H "x-ms-content-length: 183999" -H "Content-Length: 0" -H "x-ms-type: file" -H "x-ms-date: Tue, 13 Jun 2023 22:42:0 GMT" -H "x-ms-blob-type: BlockBlob"

HTTPS response with 201 - File created in the folder observation.

Then I ran an HTTPS PUT with comp=range to send data as the following command (put-range: https://learn.microsoft.com/en-us/rest/api/storageservices/put-range):

$ curl -i -X PUT "https://storage1657.blob.core.windows.net:443/test2/observation/test-1-min-obs-2023-02-28-144253.json?comp=range&<SAS key>" -H "Content-Length: 183999" -H "x-ms-range: bytes=0-183998" -H "x-ms-date: Wed, 14 Jun 2023 18:49:0 GMT" -H "x-ms-write: {update}" -H "x-ms-version: 2022-11-02" --data test-1-min-obs-2023-02-28-144253.json

Here is the response:

HTTP/1.1 200 Connection established

HTTP/1.1 400 Value for one of the query parameters specified in the request URI is invalid.

Content-Length: 274

Content-Type: application/xml

Server: Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0

x-ms-request-id: 5f4759b4-b01e-0012-7905-9f500f000000

Date: Wed, 14 Jun 2023 21:17:46 GMT

<?xml version="1.0" encoding="utf-8"?>

<Error><Code>InvalidQueryParameterValue</Code><Message>Value for one of the query parameters specified in the request URI is invalid.

RequestId:5f4759b4-b01e-0012-7905-9f500f000000
KarishmaTiwari-MSFT 20,772 Reputation points Microsoft Employee Moderator

2023-06-17T02:56:46.0833333+00:00

@Nguyen Thien Thanks for sharing the details.
Looks like you have an instance of blob service, but the API reference you linked is from azure file service.
You can try following the guidance here to create and update content on a blob - https://learn.microsoft.com/en-us/rest/api/storageservices/put-block?tabs=azure-ad#request-body
Nguyen Thien 0 Reputation points

2023-06-19T22:42:48.2566667+00:00

@KarishmaTiwari-MSFT

I have tried the following command:

curl -i -X PUT "https://storage1657.blob.core.windows.net:443/test2/observation/1-min-obs-2023-06-13-180415.json?<SAS token>&comp=block&blockid=AAAAAA%3D%3D" -H "x-ms-content-length: 183999" -H "x-ms-date: Mon, 19 Jun 2023 21:32:0 GMT" -H "x-ms-blob-type: BlockBlob" -H "Content-Type: application/json" -H "Accept: application/json" --data 1-min-obs-2023-06-13-180415.json

HTTP/1.1 200 Connection established

HTTP/1.1 201 Created

Content-Length: 0

Server: Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0

x-ms-request-id: c00ce834-b01e-0012-20fe-a2500f000000

x-ms-version: 2022-11-02

x-ms-content-crc64: 7+iGUHB67sQ=

x-ms-request-server-encrypted: true

Date: Mon, 19 Jun 2023 22:36:45 GMT

But I don't see the new file in my-container/observation/
Nguyen Thien 0 Reputation points

2023-06-20T04:40:09.5466667+00:00

Hi @KarishmaTiwari-MSFT

I have tried the following command:

curl -i -X PUT "https://storage1657.blob.core.windows.net:443/test2/observation/test-1-min-obs-2023-06-19-170001.json?<Sas token>&comp=block&blockid=AAAAAA%3D%3D" -H "x-ms-content-length: 4454" -H "x-ms-date: Tue, 20 Jun 2023 4:05:00 GMT" -H "x-ms-blob-type: BlockBlob" -H "Content-Type: application/json" -H "Content-Length: 4454" --data @1-min-obs-2023-06-13-180415.json

HTTP/1.1 200 Connection established

HTTP/1.1 100 Continue

Got Continue

2 answers

Your answer

KarishmaTiwari-MSFT 20,772 Reputation points Microsoft Employee Moderator

2023-06-15T16:04:16.0033333+00:00

@Nguyen Thien Can you please elaborate on your scenario - what are you trying to do, which Azure service is it related to and what's the end goal.

Also, share the documentation url that you are following to achieve this, if any. This would help me to reproduce the issue on my end and troubleshoot.

What issues are you seeing with the command shared? Let me know. Thanks.
Nguyen Thien 0 Reputation points

2023-06-15T16:36:53.3566667+00:00

Hi @KarishmaTiwari-MSFT the end goal is to upload a file from my linux VM to my Azure storage container "test2", in the folder observation manually. First I sent an HTTPS PUT request to upload an empty file (create-file: https://learn.microsoft.com/en-us/rest/api/storageservices/create-file):

$ curl -i -X PUT "https://storage1657.blob.core.windows.net:443/test2/observation/test-1-min-obs-2023-02-28-144253.json?<SAS key>" -H "x-ms-content-length: 183999" -H "Content-Length: 0" -H "x-ms-type: file" -H "x-ms-date: Tue, 13 Jun 2023 22:42:0 GMT" -H "x-ms-blob-type: BlockBlob"

HTTPS response with 201 - File created in the folder observation.

Then I ran an HTTPS PUT with comp=range to send data as the following command (put-range: https://learn.microsoft.com/en-us/rest/api/storageservices/put-range):

$ curl -i -X PUT "https://storage1657.blob.core.windows.net:443/test2/observation/test-1-min-obs-2023-02-28-144253.json?comp=range&<SAS key>" -H "Content-Length: 183999" -H "x-ms-range: bytes=0-183998" -H "x-ms-date: Wed, 14 Jun 2023 18:49:0 GMT" -H "x-ms-write: {update}" -H "x-ms-version: 2022-11-02" --data test-1-min-obs-2023-02-28-144253.json

Here is the response:

HTTP/1.1 200 Connection established

HTTP/1.1 400 Value for one of the query parameters specified in the request URI is invalid.

Content-Length: 274

Content-Type: application/xml

Server: Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0

x-ms-request-id: 5f4759b4-b01e-0012-7905-9f500f000000

Date: Wed, 14 Jun 2023 21:17:46 GMT

<?xml version="1.0" encoding="utf-8"?>

<Error><Code>InvalidQueryParameterValue</Code><Message>Value for one of the query parameters specified in the request URI is invalid.

RequestId:5f4759b4-b01e-0012-7905-9f500f000000
KarishmaTiwari-MSFT 20,772 Reputation points Microsoft Employee Moderator

2023-06-17T02:56:46.0833333+00:00

@Nguyen Thien Thanks for sharing the details.
Looks like you have an instance of blob service, but the API reference you linked is from azure file service.
You can try following the guidance here to create and update content on a blob - https://learn.microsoft.com/en-us/rest/api/storageservices/put-block?tabs=azure-ad#request-body
Nguyen Thien 0 Reputation points

2023-06-19T22:42:48.2566667+00:00

@KarishmaTiwari-MSFT

I have tried the following command:

curl -i -X PUT "https://storage1657.blob.core.windows.net:443/test2/observation/1-min-obs-2023-06-13-180415.json?<SAS token>&comp=block&blockid=AAAAAA%3D%3D" -H "x-ms-content-length: 183999" -H "x-ms-date: Mon, 19 Jun 2023 21:32:0 GMT" -H "x-ms-blob-type: BlockBlob" -H "Content-Type: application/json" -H "Accept: application/json" --data 1-min-obs-2023-06-13-180415.json

HTTP/1.1 200 Connection established

HTTP/1.1 201 Created

Content-Length: 0

Server: Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0

x-ms-request-id: c00ce834-b01e-0012-20fe-a2500f000000

x-ms-version: 2022-11-02

x-ms-content-crc64: 7+iGUHB67sQ=

x-ms-request-server-encrypted: true

Date: Mon, 19 Jun 2023 22:36:45 GMT

But I don't see the new file in my-container/observation/
Nguyen Thien 0 Reputation points

2023-06-20T04:40:09.5466667+00:00

Hi @KarishmaTiwari-MSFT

I have tried the following command:

curl -i -X PUT "https://storage1657.blob.core.windows.net:443/test2/observation/test-1-min-obs-2023-06-19-170001.json?<Sas token>&comp=block&blockid=AAAAAA%3D%3D" -H "x-ms-content-length: 4454" -H "x-ms-date: Tue, 20 Jun 2023 4:05:00 GMT" -H "x-ms-blob-type: BlockBlob" -H "Content-Type: application/json" -H "Content-Length: 4454" --data @1-min-obs-2023-06-13-180415.json

HTTP/1.1 200 Connection established

HTTP/1.1 100 Continue

Got Continue

Answer 1

My file share successful experience for your reference:

$ curl -i -X PUT "https://storage1657.file.core.windows.net/test2/observation/test-1-min-obs-2023-02-28-144253.json?<SAS key>" -H "x-ms-content-length: 183999" -H "Content-Length: 0" -H "x-ms-type: file" -H "x-ms-version: 2023-08-03"

$ curl -i -X PUT "https://storage1657.file.core.windows.net/test2/observation/test-1-min-obs-2023-02-28-144253.json?<SAS key>&comp=range" -H "x-ms-write: update" -H "x-ms-range: bytes=0-183998" -H "x-ms-version: 2023-08-03" --upload-file "1-min-obs-2023-02-28-144253.json"

Answer 2

Reddy Bhaskar Vengala 0

Hi David,

I am trying to access file share folder using SAS link from browser/postman, but it is giving below error. ( SAS link is working fine for individual files inside file share folder)

"Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature"

Could you please help on this.

thanks.

Share via

How to run curl command for Azure REST API with comp=range

2 answers

Your answer