error apply requirement file Apache spark pool

Dennis Gillon 0 Reputation points
2024-10-21T08:20:48.7766667+00:00

When applying a requirement file for an Apacha Spark pool, i get an error:"isSessionTimedOut":null,"isStreamingQueryExists":"false","impulseErrorCode":"Spark_System_Conda_ExternalNetworkIssue","impulseTsg":"Library management reaches out to an external service (Pip/Conda) to retrieve library metadata.\nInterruptions in their service will cause library management to fail.\nSuggestion:\nWe cannot control outside services so retry is the only mitigation.\n","impulseClassification":"System","isInterpreterDied":"false"},"state":"dead","log":["An HTTP error occurred when trying to retrieve this URL.","HTTP errors are often intermittent, and a simple retry will get you on your way.","'https//conda.anaconda.org/conda-forge/linux-64'","","","24/10/21 08:04:19 ERROR b"Warning: you have pip-installed dependencies in your environment file, but you do not list pip itself as one of your conda dependencies. Conda may not use the correct pip to install your packages, and they may end up in the wrong place. Please add an explicit pip dependency. I'm adding one for you, but still nagging you.\nCollecting package metadata (repodata.json)

The requirement file:

azure-keyvault==4.2.0

azure-keyvault-secrets==4.6.0

If I add a pip dependency (pip==23.3.1) as ask in the error message, the erros stays the same...

How can i solve this error?

Thanks,

Regards,

Dennis

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,975 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.