Azure Synapse Spark pool pricing

Robson Pelegrini 41 Reputation points
2022-08-02T16:55:59.063+00:00

I have one doubt about cost of spark pool in synapse.

I have a spark pool with automatically pauses for 15 minutes idle, but I think it's costing more than expected.

For example, If two users runs different notebooks in the same pool during 10 minutes in the same time, we'll be charged per 10 or 20 minutes?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,373 questions
0 comments No comments
{count} votes

Accepted answer
  1. Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator
    2022-08-02T19:54:10.47+00:00

    Hello @Robson Pelegrini ,

    Thanks for the question and using MS Q&A platform.

    Using Synapse Spark pools, You're charged for the number of instances and the hours running.

    Spark Instance:
    Spark instances are created when you connect to a Spark pool, create a session, and run a job. As multiple users may have access to a single Spark pool, a new Spark instance is created for each user that connects.

    When you submit a second job, if there is capacity in the pool, the existing Spark instance also has capacity. Then, the existing instance will process the job. Otherwise, if capacity is available at the pool level, then a new Spark instance will be created.

    For your question, since two users will connect to the same spark pool, two separate spark instances will be created. So you will be charged on both instances.
    In total, you will be charged for 10 mins +2 instances (assuming both users are using 1 instance each during the 10 mins time)

    Please check the below documentation to understand the spark pool pricing better.

    https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-concepts#spark-instances

    https://learn.microsoft.com/en-us/azure/synapse-analytics/plan-manage-costs

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    2 people found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.