how can I run PySpark in an Azure Function App?

Eduardo Soares Penido 11 Reputation points
2022-11-10T14:41:45.833+00:00

Hi.

I'm struggling to run pyspark in an Azure Function App.
It returns me Java Runtime error.
Is there a way to set Az Function App configuration to run PySpark?

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,481 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Leonardo Martins 0 Reputation points
    2024-04-29T15:36:33.7033333+00:00

    The best approach is likely to use a docker image to get all the dependencies packaged up; the following AWS project (Spark on AWS Lambda (SoAL) ) can be a good starting point to configure an Azure function equivalent.

    0 comments No comments