Share via

Unable to reach pypi.org from Azure Synapse Notebooks

Raghul Kannan 191 Reputation points
2023-07-24T18:10:37.2033333+00:00

I'm unable to reach pypi.org and thus not able to install any pip components from my Azure Synapse Notebooks.

I have firewall configured and have whitelisted the following.

FQDN's: pypi.python.org,pypi.org,pythonhosted.org,files.pythonhosted.org

Ports: Http:80,Https:443,Https:3128

But I'm still unable to reach pypi.org

Azure Firewall
Azure Firewall
An Azure network security service that is used to protect Azure Virtual Network resources.
779 questions
Azure
Azure
A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.
1,418 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,375 questions
0 comments

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. ChaitanyaNaykodi-MSFT 27,476 Reputation points Microsoft Employee Moderator
    2023-07-24T23:05:28.0566667+00:00

    @Raghul Kannan Thank you for reaching out.

    As the question is tagged with Azure firewall, I am assuming you have configured applications rules to allow FQDN's pypi.python.org,pypi.org,pythonhosted.org,files.pythonhosted.org with protocols Http:80,Https:443,Https:3128 but you are still unable to install any pip components and unable to reach pypi.org

    Based on my understanding above, you can try below mentioned troubleshooting steps and see if you are able to resolve the issue.

    • As you are unable to reach pypi.org, this can be a DNS issue. To validate you can run the command nslookup pypi.org and see if it is resolving an IP address. If there is no output received, you can check if you need to configure a Network rule on your firewall to allow communication via port 53(DNS). You can follow the example here.
    • Next you can try to enable diagnostic logging for your Azure Firewall and validate if any firewall rule is blocking this connectivity.
    • This issue can be also related to NSGs deployed in your virtual network which might block this connectivity. You can follow this documentation here to help diagnose the nsg rules.

    Hope this helps! Please let me know if the issue still persists. Thank you!

  2. Raghul Kannan 191 Reputation points
    2023-07-26T04:05:52.2266667+00:00

    Hi,

    The issue was I had created synapse workspace with Data Exfiltration enabled, I re-created with it being disabled and everything is working as expected now

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.