Adding external spark packages/jars to spark pool during deployment.

Question

By following the steps here: https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-manage-pool-packages I am able to upload an external jar as a spark pool package.

May I know what is the right way to add such packages to spark pool during the deployment using ADO?
We currently use arm templates to deploy service artifacts in different environments.

Answer 1

Hello @- ,

Are you looking for non-UI ways of adding packages to your spark pool? If yes, then we have az CLI and REST APIs that can be used in CI/CD.
You can find documentation on that in this section: https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-azure-portal-add-libraries#manage-your-packages-outside-synapse-analytics-ui

Hope this info helps.

----------

Please do consider clicking on "Accept Answer" and "Upvote" on the post that helps you, as it can be beneficial to other community members.