Can we create R Server on HDInsight 4.0?

Question

Can we create R Server on HDInsight 4.0?

[Note: As we migrate from MSDN, this question has been posted by an Azure Cloud Engineer as a frequently asked question]

Sourced from Docs - Azure HDInsight R Server

Answer 1

Welcome to the Microsoft Q&A platform.

Happy to answer your questions.

The ML Services cluster type on HDInsight is supported only on HDInsight 3.6.

Note: HDInsight 3.6 is scheduled to retire on December 31, 2020.

Reference: Azure HDinsight – R Server Overview

Hope this helps.

Sourced from Docs - Azure HDInsight R Server

Answer 2

Thx @karishmatiwari-msft for the answer.

We are currently implementing in-house / on-prem machine learning solutions in R (RStudio). We are in the process of moving our data to the cloud by the means of a sophisticated ingestion process through Apache Nifi. Currently the data lands on an Azure Blob storage as an Avro file with a corresponding Hive table around it. We also created an HDInsight Spark cluster 3.6 to query the data.

We realized that the HDI cluster of type rserver (ML Services) does not have ESP support and that it will be retired by the end of the year. ESP support is crucial for us as we work in a large, international company with strict security / privacy rules.

Having said that, I wonder what are the best working Azure cloud solutions to work with R / RStudio?

Best regards
Christoph