Hello Mike!
Could you please try to check and see if you have access to mc_jollybush-xxxxxxxx-rg_jollybush-xxxxxxxx_westeurope/providers/Microsoft.Network/loadBalancers/kubernetes from [https://resources.azure.com/?
If yes, please try to remove the reference to aks-agentpool-28130424-vmss.
To be able to perform changes, at resources.azure.com level, please switch to "Read/Write" -> select the "kubernetes" LB -> remove the reference from the JSON -> PUT. After this, try again to remove the kubernetes LB.
Please "Accept as Answer" and Upvote if it helped, so that it can help others in the community looking for help on similar topics.
Thank you!