Azcopy not copying from AWS S3 to Azure Blob

Question

Hi,

I am unable to download data from AWS S3 bucket to Azure Blob. Could you suggest if i am missing something ? My data size is roughly 20G.

[onetick@OnetickVM ~]$ export AWS_ACCESS_KEY_ID=******************
[onetick@OnetickVM ~]$ export AWS_SECRET_ACCESS_KEY=Q4*******FtQ************
[onetick@OnetickVM ~]$ azcopy cp 'https://s3://onetick-share/csrfxustaq/20200605' 'https://myblobstorageaccounthot.blob.core.windows.net/onetick-archive?sv=2019-02-02&st=2020-06-10T&&&&(&*0Z&se=2020-06-11T08%3A06%3A00Z&sr=c&sp=rwl&sig=f*****************g%*&D' --recursive=true
INFO: Scanning...
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support
failed to perform copy command due to error: cannot start job due to error: cannot scan the path /home/onetick/https:/s3:/onetick-share/csrfxus, please verify that it is a valid.

I also tried with "aws cli" tool but that also didn't work.

[onetick@OnetickVM ~]$ /usr/local/bin/aws s3 sync s3://onetick-share/csrfxus/taq/20200605 ./
<botocore.awsrequest.AWSRequest object at 0x7f1eefa61a20>
[onetick@OnetickVM ~]$

Thanks,
Rakesh

Answer 1

@RakeshKumarTiwary

Anyway, S3 URLs are formatted a bit more like s3.region.amazonaws.com/bucket/objectkey
alternatively: https://bucket.s3.region.amazonaws.com/objectkey

azcopy doesn't support this because of the lack of region information, etc.

Additional information: Move your data from AWS S3 to Azure Storage using AzCopy

Hope this helps!

Kindly let us know if the above helps or you need further assistance on this issue.

------------------------------------------------------------------------------------------------------------------------------------------

Please don’t forget to "Accept the answer" wherever the information provided helps you, this can be beneficial to other community members.