SparkLoggingEvent_CL is not being gained in log analytics

Arudchayan Pirabaharan 20 Reputation points
2023-03-15T15:03:41.08+00:00

I have configured log analytics and spark according to https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-azure-log-analytics
The metrics and listener have arrived to log analytics but logging event has not ,I have setup the pyspark logging as per the article and can view the logs through synapse monitor spark pool logs

Any help would be greatly appreciated
Thank you in advance

Update:

The problem seemed to be in the key vault secret setup as directly providing the log analytics key to conf works.
The key Vault has been linked though linked service and synapse has been given access policy access in key Vault.

Is there anything else I have overlooked @AnnuKumari-MSFT @C

Any pointers would be greatly appreciated

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,471 questions
{count} votes