HDInsight Version 3.6 is Deprecated,User SubscriptionId 'XXX' does not have cores left to create resource 'hdi-kafka'. Required: 38, Available: 0.
I am going through this tutorial and getting this error when trying to create a HDInsight cluster: HDInsight Version 3.6 is Deprecated,User SubscriptionId 'XXX' does not have cores left to create resource 'hdi-kafka'. Required: 38, Available: 0. This…
Unable to create HDInsight cluster using Microsoft tutorial
I am a student trying to learn how to setup HDInsight Hadoop cluster. I have signed up and received the free $200 credit. I am following the steps laid out in Microsoft's tutorial here:…
How to restart the Kafka services on HDInsight Kafka Cluster
Im trying to restart the kafka services which were configured on HDInsight kafka cluster as below. But they are getting timeout. Please advise how to proceed. n0-kafkah:/usr/hdp/4.1.18.1/kafka/bin$ sudo ./kafka-server-start.sh…
Active worker nodes usage in HDinsight cluster for the period of last one year
Hi Team, Can someone help us to get the Active worker nodes usage in HDinsight cluster for the period of last one year. Thanks & Regards, Udaya
Why does HDInsight quota show 0 available cores?
When I view my quotas, I am not using any vCores, and it says I have 36 cores available. But when I try to set up a HDInsight Spark Cluster in the West Europe region it says I have 0 available. I have a pay-as-you basic subscription.
How to implement CI/CD on HDInsight ?
Hi, I need recommendations about how to apply CI/CD in HDinsight. I want to create "dev" and "prod" cluster. One Spark and one Hive IQ each. Let's…
Find activity logs sent to a log analytics workspace via a diagnostic setting
I am trying to export the activity logs of an HDInsight cluster, to a log anaytics workspace via a diagnostic setting. But I am unable to find the exported logs. I tried using the following query: search * | where TimeGenerated == "z" How…
Register button is disabled for Azure HDInsight
Hello, I hope this message finds you well. We are having an issue with the registration button for the HDInsight resource provider in the Azure portal. When trying to register from the account of the user with the global adminitiration role, I noticed…
Zero cores available to create Hdinsight cluster
I am using West Central Germany time zone to create a very small hd-insight Hadoop cluster but there are zero cores available. I have open a ticket with the tech support but still no quota allocated. I really need this to be done. Please help
Cores quota limit in HDInsight
I am trying to create HDInsight Spark cluster, however getting below error : You have reached your subscription's cores quota limit in France Central. Please choose a different region or request billing support to increase your limit for France…
ConnectException org.fluentd.logger.sender.RawSocketSender with Azure Monitor Integration
When we enabled Azure Monitor on our HDInsight cluster (https://learn.microsoft.com/en-us/azure/hdinsight/log-analytics-migration) we got the following exception when running Spark jobs: 22/04/06 12:15:29 ERROR RawSocketSender…
How to run spark streaming on azure synapse (which activity to choose to have a continuous run)
Hello community! I'm looking for the best way to run spark streaming on synapse (data is coming from event hub). I was thinking about Spark job definition, but spark job definition has a limited amount of time an activity can run (Default is 12 hours,…
HDInsight in Trial account.
I resister for HDInsight separately in my Trial account. Can I create HDInsight Clusters under Free Trial subscription or will there be any cost implications?
InvalidNetworkConfigurationErrorCode Error message Virtual Network configuration is incompatible with HDInsight requirements. Error: 'Cluster Validation timed out.',
created hdinsight cluster for kafka but it is failing . Went through the documentation but unable to resolve
The User Assigned Identity not appearing when creating an HDI cluster
How can I select my User Assigned Identity when creating an HDI cluster with storage lake gen2 storage? Despite creating the appropriate identity and attaching it to the storage lake with the 'Storage Blob Data Owner' permission, nothing shows up in the…
HDInsight Kafka Clusters certificate expire every month or do we have any Maintenace activity's will happen in HDInsight kafka clusters in Azure
We recently created Azure HDInsight kafka clusters. Just want to know did Azure do any maintenace activity's like Certificate renews or any security patching. as we are new to use these services. just want to know about that. Thank you.
Unable to register HD Insights resource provider in my Azure Subscription
I'm trying to create a resource group via a terraform script an am unable to. The HD Insight resource provider is stuck at the registering step. So I deleted the subscription. Created a new one and manually tried to register HD Insights and it was still…
Why is the Resource provider Microsoft.HDInsight stuck on Registering?
From the Azure portal I can see the Resource provider Microsoft.HDInsight is stuck on "Registering" status and has been for a couple of hours since I first looked. I've tried to unregister and register again but that just times out. My account…
Registering a HDInsight resource provider never completes
Hi Trying to create an HDInsight cluster but the Microsoft.HDInsight resource provider was not registered. I click on register and left the process overnight. This morning it still showing "Registering". Can anyone help?
How will Azure Application Insight help to optimize my application
Hello ! I would like to know how will enabling Azure application insight help me to analyze the performance issues in my application . WIll enabling this slow down my application / is there anything we need to check before this is enabled. Thanks