Error While Running Pyspark in an Azure Function (Error: Java gateway process exited before sending its port number)

Danny Peletski 0 Reputation points
2023-08-09T20:32:35.7166667+00:00

I'm running into the following error when testing out my Azure Function:

Error: Java gateway process exited before sending its port number.

This occurs when attempting to execute the following line of code:

spark = SparkSession.builder.master('local[*]').appName("GetHighWatermark").getOrCreate()


Any ideas as to why this may be happening and what the solution to it may be? Thanks.

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
5,911 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.