AzCopy Support for On premise HDFS

Question

Hi,
Can we use AzCopy to transfer on-prem hdfs files to ads gen2 ?

Thanks,
Soumitra.

Answer 1

Unfortunately I don't see On-premise hdfs support in the document here - storage-ref-azcopy-copy

But see if below options help i.e. ADF & Azure data box

https://learn.microsoft.com/en-us/azure/data-factory/data-migration-guidance-hdfs-azure-storage

https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-migrate-on-premises-hdfs-cluster

----------

Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav

Answer 2

@Soumitra Firstly, apologies for the delay in responding here and any inconvenience this issue may have caused.

so you cannot access the local hdfs as a file-system. Can we use AzCopy to transfer on-prem hdfs files to ads gen2 ? NO

You may wish to leave your feedback on blocking access based on the session details on Uservoice.

Workaround: https://learn.microsoft.com/en-us/azure/data-factory/connector-azure-data-lake-storage
Hope this helps!

Kindly let us know if the above helps or you need further assistance on this issue.

--------------------------------------------------------------------------------------------------------------------------------

Please don’t forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.