Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
3,645 questions
How should be the application insight javaagent called in spark submit command?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 59%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGA%3C/text%3E%3C/svg%3E)
Goel, Akanksha
66
Reputation points
I am using :
https://learn.microsoft.com/en-us/azure/azure-monitor/app/java-in-process-agent
I want to log messages with the help of application insight java agent but sending through the following command is not helping
spark-submit --name $job_name --class com.dell.sadh.azure.SACClickstreamParser --master yarn --deploy-mode cluster --verbose \
--num-executors 2 --driver-memory 4g --executor-memory 16g --executor-cores 4 --files $APPLICATION_CONFIG,$APPLICATIONINSIGHT_CONFIG \
--packages org.apache.spark:spark-sql-kafka-0-10_2.11:2.4.0 \
--conf 'spark.driver.extraJavaOptions=-Dlog4jspark.root.logger=INFO,console -javaagent:"applicationinsights-agent-3.0.1-BETA.2.jar"' \
--conf 'spark.executor.extraJavaOptions=-Dlog4jspark.root.logger=INFO,console -javaagent:"applicationinsights-agent-3.0.1-BETA.2.jar"' \
--jars "applicationinsights-agent-3.0.1-BETA.2.jar" $HOME/$jar_name $env application.conf &> ${LOG}
Can anybody help me on this?
Azure Monitor
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT 26,236 Reputation points2021-01-05T23:14:13.343+00:00 Hello @Goel, Akanksha and welcome to Microsoft Q&A.
When you say the command is not helping, what exactly happens? Does it give an error message?
-
Goel, Akanksha 66 Reputation points
2021-01-06T06:43:57.35+00:00 I am getting this error:
2021-01-06 06:30:34.738Z ERROR c.m.applicationinsights.agent -
ApplicationInsights Java Agent 3.0.1-BETA.2 failed to start
Description:
No connection string or instrumentation key provided
Action:
Please provide connection string or instrumentation key.I have placed the connection string in the application insight json file in the same directory as the applicationinsights-agent-3.0.1-BETA.2.jar.
This is my applicationinsights.json looking like:
{
"connectionString": "InstrumentationKey=a34c636d-4af5-4c35-adf7-88e602a278bb;IngestionEndpoint=https://southcentralus-0.in.applicationinsights.azure.com/",
"role": {
"name": "runningtest"
},
"instrumentation": {
"logging": {
"level": "WARN"
}
}
} -
bharathn-msft 5,106 Reputation points Microsoft Employee Moderator2021-01-12T22:25:56.267+00:00 @Goel, Akanksha My sincere apologies for delayed response on this thread, it was redirected accordingly on time but sorry couldn't get to this thread until now. Will further review the scenario you are facing and reply back to you at the earliest opportunity.
Sign in to comment
Sign in to answer