How to allow inbound traffic in AKS coming from application running in Azure Synapse Spark Pool

Akhilesh Pachipulusu​ 5 Reputation points
2023-03-17T12:03:34.3866667+00:00

We have some APIs running in microservices inside AKS which is attached to a private network with inbound and outbound rules. We have spark jobs running in Synapse studio which have to call the APIs running AKS. How to configure the network or how to allow the traffic from Synapse spark pool.

Azure Kubernetes Service (AKS)
Azure Kubernetes Service (AKS)
An Azure service that provides serverless Kubernetes, an integrated continuous integration and continuous delivery experience, and enterprise-grade security and governance.
1,845 questions
{count} vote

2 answers

Sort by: Most helpful
  1. risolis 8,701 Reputation points
    2023-03-19T05:05:55.58+00:00

    Hello @Akhilesh Pachipulusu​

    Thank you for posting this concern on this community space.

    I was reading your case scenario description and I was reading the following article that I thought it might be work for your environment.

    https://blog.cellenza.com/en/data/using-spark-with-kubernetes-k8s/

    I hope that can be useful for you.

    Looking forward to your feedback,

    Cheers,

    Please "Accept the answer" if the information helped you. This will help us and others in the community as well.


  2. Akhilesh Pachipulusu​ 5 Reputation points
    2023-03-30T12:26:49.38+00:00

    The solution is to create a private link service using the load balancer of the AKS and create a managed private endpoint in the synapse workspace. Use the URL defined in the manage endpoint to access the APIs