AKS cluster creation taking too long

Question

AKS cluster creation is taking too much time. After 1 hr stated seeing below error

{
  "name": "3278d4d2-0c6c-9b49-a467-f63077a59b63",
  "status": "InProgress",
  "startTime": "2023-05-18T13:03:46.3888732Z",
  "error": {
   "code": "CreateVMSSAgentPoolFailed",
   "message": "AKS encountered an internal error while attempting the requested Creating operation. AKS will continuously retry the requested operation until successful or a retry timeout is hit. Check back to see if the operation requires resubmission. Correlation ID: 4c826ef7-ef14-4d64-a384-b3a4261d85a8, Operation ID: d2d47832-6c0c-499b-a467-f63077a59b63, Timestamp: 2023-05-18T16:17:52Z."
  }
 }

vmssCSE (Microsoft.Azure.Extensions.CustomScript, 2.1.7) showning below errors

Message
Enable failed: failed to execute command: command terminated with exit status=124 [stdout] { "ExitCode": "124", "Output": " sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 59 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 60 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 61 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 62 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 63 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 64 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 65 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 66 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 67 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 68 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 69 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 70 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 71 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 72 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 73 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 74 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 75 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 76 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 77 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 78 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 79 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 80 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io\n++ '[' 81 -eq 100 ']'\n++ sleep 1\n++ for i in $(seq 1 $retries)\n++ timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io", "Error": "", "ExecDuration": "900", "KernelStartTime": "Thu 2023-05-18 19:06:32 UTC", "CloudInitLocalStartTime": "Thu 2023-05-18 19:06:34 UTC", "CloudInitStartTime": "Thu 2023-05-18 19:06:37 UTC", "CloudFinalStartTime": "Thu 2023-05-18 19:07:03 UTC", "NetworkdStartTime": "Thu 2023-05-18 19:06:35 UTC", "CSEStartTime": "Thu May 18 19:07:11 UTC 2023", "GuestAgentStartTime": "Thu 2023-05-18 19:06:53 UTC", "SystemdSummary": "Startup finished in 478ms (firmware) + 1.210s (loader) + 1.345s (kernel) + 31.187s (userspace) = 34.220s \ngraphical.target reached after 30.498s in userspace", "BootDatapoints": { "KernelStartTime": "Thu 2023-05-18 19:06:32 UTC", "CSEStartTime": "Thu May 18 19:07:11 UTC 2023", "GuestAgentStartTime": "Thu 2023-05-18 19:06:53 UTC", "KubeletStartTime": "Thu 2023-05-18 19:07:15 UTC" } } [stderr]

Answer 1

Hello A E, Raghu

As you can see within the error, the issue is the fact that it is timing out when resolving the FQDN of the API server: "timeout 10 nslookup devaksdns-2mbrjkwj.hcp.eastus.azmk8s.io"

You are probably using a custom DNS server at AKS VNET level. If yes, please make sure the DNS server is able to resolve that FQDN or use the Azure-provided DNS:

Hopefully this is what you are looking for! If you have additional questions, please let us know in the comments.

If this has been helpful, please take a moment to accept answers as this helps increase visibility of this question for other members of the Microsoft Q&A community. Thank you for helping to improve Microsoft Q&A!