Notebook code to retrieve spark pool tags

Question

Notebook code to retrieve spark pool tags

Nathan 1

When running a Pyspark notebook interactively or in a pipeline, how to retrieve the Spark Pool tags? Please provide code example. Thx

PRADEEPCHEEKATLA-MSFT 56,301 Reputation points Microsoft Employee

2022-09-05T09:17:19.007+00:00

Hello @Nathan ,

Thanks for the question and using MS Q&A platform.

What do you mean by retrieve the Spark pool tags - Can you please elaborate your ask bit more?
Nathan 1 Reputation point

2022-09-05T10:56:00.517+00:00

Using the "Manage" left toolbar menu item, when creating an Apache Spark pool, key value pair "Tags" can be defined. This link describes and shows the "Tags" entry screen.

https://www.sqlshack.com/working-with-spark-pools-in-azure-synapse-analytics/
PRADEEPCHEEKATLA-MSFT 56,301 Reputation points Microsoft Employee

2022-09-06T08:37:38.747+00:00

Hello @Nathan ,

Please confirm that you want to get Azure Tags (name/value) pairs in pyspark notebook? OR your ask is different?
Nathan 1 Reputation point

2022-09-06T09:57:27.63+00:00

Yes. I want to get Azure Tags (name/value) pairs in pyspark. Please provide example code. Thx.
PRADEEPCHEEKATLA-MSFT 56,301 Reputation points Microsoft Employee

2022-09-07T10:23:04.19+00:00

Hello @Nathan ,

We are reaching out to the internal team to get help on the above ask, I will update you once I get the required information.
PRADEEPCHEEKATLA-MSFT 56,301 Reputation points Microsoft Employee

2022-09-13T05:20:37.79+00:00

Hello @Nathan ,

We are still awaiting for the response from the internal team. I will update you once I get the required information.

Stay tuned!
PRADEEPCHEEKATLA-MSFT 56,301 Reputation points Microsoft Employee

2022-09-21T06:47:16.067+00:00
Hello @Nathan ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.

PRADEEPCHEEKATLA-MSFT 56,301 Reputation points Microsoft Employee

2022-09-05T09:17:19.007+00:00

Hello @Nathan ,

Thanks for the question and using MS Q&A platform.

What do you mean by retrieve the Spark pool tags - Can you please elaborate your ask bit more?
Nathan 1 Reputation point

2022-09-05T10:56:00.517+00:00

Using the "Manage" left toolbar menu item, when creating an Apache Spark pool, key value pair "Tags" can be defined. This link describes and shows the "Tags" entry screen.

https://www.sqlshack.com/working-with-spark-pools-in-azure-synapse-analytics/
PRADEEPCHEEKATLA-MSFT 56,301 Reputation points Microsoft Employee

2022-09-06T08:37:38.747+00:00

Hello @Nathan ,

Please confirm that you want to get Azure Tags (name/value) pairs in pyspark notebook? OR your ask is different?
Nathan 1 Reputation point

2022-09-06T09:57:27.63+00:00

Yes. I want to get Azure Tags (name/value) pairs in pyspark. Please provide example code. Thx.
PRADEEPCHEEKATLA-MSFT 56,301 Reputation points Microsoft Employee

2022-09-07T10:23:04.19+00:00

Hello @Nathan ,

We are reaching out to the internal team to get help on the above ask, I will update you once I get the required information.
PRADEEPCHEEKATLA-MSFT 56,301 Reputation points Microsoft Employee

2022-09-13T05:20:37.79+00:00

Hello @Nathan ,

We are still awaiting for the response from the internal team. I will update you once I get the required information.

Stay tuned!
PRADEEPCHEEKATLA-MSFT 56,301 Reputation points Microsoft Employee

2022-09-21T06:47:16.067+00:00

Hello @Nathan ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.

Answer 1

Hello @Nathan ,

Unfortunately, there is no spark commad which gives the Spark pool tags in your notebook.

For alternative method, you can checkout the SO thread: https://stackoverflow.com/questions/73601576/azure-synapse-notebook-code-to-retrieve-spark-pool-tags

Hope this will help. Please let us know if any further queries.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
Want a reminder to come back and check responses? Here is how to subscribe to a junotification
If you are interested in joining the VM program and help shape the future of Q&A: Here is jhow you can be part of Q&A Volunteer Moderators

Notebook code to retrieve spark pool tags

1 answer

Activity