How to install python package in hardware accelerated GPU spark pool ?

Prateek Narula 41 Reputation points
2022-06-08T10:12:55.267+00:00

I've a azure synapse analytics workspace in region North Europe, as the region has hardware Accelerated pools, GPU base pools so to say. But i don't see the packages setting.
here is the comparison for 2 workspace, 1 in north Europe and other one in West Europe.
209418-screenshot-2022-06-08-at-120209.png vs 209494-screenshot-2022-06-08-at-120550.png

Even the package setting in the Workspace itself is disabled for me: here is the screenshot.
209434-screenshot-2022-06-08-at-120143.png

I've 2 questions in this reagrd:

  • Am I missing any configuration for the GPU pool or this feature is not released?
  • Is there any alternate way to install a package? pip install or pip3 install are not working.
Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,951 questions
Azure Analysis Services
Azure Analysis Services
An Azure service that provides an enterprise-grade analytics engine.
456 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,973 questions
{count} votes

Accepted answer
  1. PRADEEPCHEEKATLA-MSFT 90,146 Reputation points Microsoft Employee
    2022-06-09T10:30:59.817+00:00

    Hello @Prateek Narula ,

    Thanks for the question and using MS Q&A platform.

    (UPDATE:6/10/2022): Unfortunately, we do not have Library Management (Package) support for GPU spark pools in Azure Synapse Analytics.

    ---------------------------------------------------

    As per the repro, I had noticed similar behaviour.

    Looks like packages are only supported for Node size family: "Memory Optimized" - let me get a confirmation from the product team.

    209808-synape-gpu.gif

    We are reaching out to internal team to get more information related to this issue and will get back to you as soon as we have an update.

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.