How to run hdfs commands from my on prem cluster to azure?

Richmond Yu 1 Reputation point
2022-05-16T20:56:10.407+00:00

Hi experts,
How to run hdfs commands from my on prem cluster to azure?
So I have an on prem cluster that I would like to run hdfs commands to read files that are from my Azure HDinsight cluster.

How can I do this?

Thanks,

Azure HDInsight
Azure HDInsight
An Azure managed cluster service for open-source analytics.
199 questions
{count} votes

1 answer

Sort by: Most helpful
  1. PRADEEPCHEEKATLA-MSFT 79,551 Reputation points Microsoft Employee
    2022-05-17T05:47:26.93+00:00

    Hello @Richmond Yu ,

    Thanks for the question and using MS Q&A platform.

    Unfortunately, you cannot run hdfs commands from on-premise cluster to Azure HDInsight cluster.

    Note: You need to migrate on-premises Hadoop data to Azure Data Lake Storage Gen2 and then create Azure HDInsight cluster with the ADLS Gen2.

    For more details, refer to Migrate on-premises Apache Hadoop clusters to Azure HDInsight.

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators