Azure Synapse - Apache Spark pool configuration for version 3.3

Question

Azure Synapse - Apache Spark pool configuration for version 3.3

Anonymous

Hi all,

I am setting up Apache spark pool configuration.

I am very hard to find any Microsoft documentation that describe how to set up Apache Spark configuration for version 3.3. The old document (https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-azure-log-analytics) showed how to upload a Text config file from local, but it doesn't support anymore.

I am configuring to monitor Spark activity to Azure Log Analytics.

Anyone has the experience with this situation. Please help.

Appreciated.

Smaran Thoomu 24,110 Reputation points Microsoft External Staff Moderator

2023-12-01T07:22:08.07+00:00

@Anonymous We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Smaran Thoomu 24,110 Reputation points Microsoft External Staff Moderator

2023-12-04T06:17:49.93+00:00

@Anonymous We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

1 answer

Your answer

Smaran Thoomu 24,110 Reputation points Microsoft External Staff Moderator

2023-12-01T07:22:08.07+00:00

@Anonymous We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Smaran Thoomu 24,110 Reputation points Microsoft External Staff Moderator

2023-12-04T06:17:49.93+00:00

@Anonymous We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Answer 1

Hi @Anonymous
Thank you for reaching out to us with your query regarding Apache Spark pool configuration in Azure Synapse.

I understand that you are having trouble finding Microsoft documentation on how to set up Apache Spark configuration for version 3.3. I'm sorry to hear that the old method of uploading a text config file from local is no longer supported. However, I'm here to help you with the latest method of configuring the Apache Spark pool.

To configure the Apache Spark pool, I suggest using the Azure Synapse Studio. You can find detailed information on how to configure the Apache Spark pool in Azure Synapse Studio

Regarding monitoring Spark activity to Azure Log Analytics, you can refer this monitor your Apache Spark

I hope this helps!

Share via

Azure Synapse - Apache Spark pool configuration for version 3.3

1 answer

Your answer