question

RakeshKumarTiwary-8609 avatar image
0 Votes"
RakeshKumarTiwary-8609 asked SumanthMarigowda-MSFT action

Azcopy not copying from AWS S3 to Azure Blob

Hi,

I am unable to download data from AWS S3 bucket to Azure Blob. Could you suggest if i am missing something ? My data size is roughly 20G.

[onetick@OnetickVM ~]$ export AWS_ACCESS_KEY_ID=
[onetick@OnetickVM ~]$ export AWS_SECRET_ACCESS_KEY=Q4*FtQ
[onetick@OnetickVM ~]$ azcopy cp 'https://s3://onetick-share/csrfxustaq/20200605' 'https://myblobstorageaccounthot.blob.core.windows.net/onetick-archive?sv=2019-02-02&st=2020-06-10T&&&;
&(&0Z&se=2020-06-11T08%3A06%3A00Z&sr=c&sp=rwl&sig=f**g%&D' --recursive=true
INFO: Scanning...
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
failed to perform copy command due to error: cannot start job due to error: cannot scan the path /home/onetick/https:/s3:/onetick-share/csrfxus, please verify that it is a valid.
*


I also tried with "aws cli" tool but that also didn't work.


[onetick@OnetickVM ~]$ /usr/local/bin/aws s3 sync s3://onetick-share/csrfxus/taq/20200605 ./
<botocore.awsrequest.AWSRequest object at 0x7f1eefa61a20>
[onetick@OnetickVM ~]$

Thanks,
Rakesh


azure-blob-storageazure-migrate
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

SumanthMarigowda-MSFT avatar image
1 Vote"
SumanthMarigowda-MSFT answered StegemanChadJ-8869 commented

@RakeshKumarTiwary-8609

Anyway, S3 URLs are formatted a bit more like s3.region.amazonaws.com/bucket/objectkey
alternatively: https://bucket.s3.region.amazonaws.com/objectkey

9851-capture.jpg


azcopy doesn't support this because of the lack of region information, etc.

Additional information: Move your data from AWS S3 to Azure Storage using AzCopy

Hope this helps!

Kindly let us know if the above helps or you need further assistance on this issue.



Please don’t forget to "Accept the answer" wherever the information provided helps you, this can be beneficial to other community members.



capture.jpg (56.0 KiB)
· 4
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@RakeshKumarTiwary-8609 Just checking in to see if the above answer helped. If this answers your query, please don’t forget to "Accept the answer" and Up-Vote for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

0 Votes 0 ·

@RakeshKumarTiwary-8609 Just checking in to see if the above answer helped. If this answers your query, please don’t forget to "Accept the answer" and Up-Vote for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

0 Votes 0 ·

@RakeshKumarTiwary-8609 Just checking in to see if the above answer helped. If this answers your query, please don’t forget to "Accept the answer" and Up-Vote for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.


0 Votes 0 ·

Can you use AZ Copy to copy data from S3 configurable storage (on premise) to azure cloud? I think that might be the issue that both the original person is asking about and I'm having issues with.

0 Votes 0 ·