Get-AzureHDInsightJobOutput

[This topic is pre-release documentation and is subject to change in future releases. Blank topics are included as placeholders.]

Get-AzureHDInsightJobOutput

Retrieves the log output for a job from the storage account associated with a specified cluster.

Syntax

Parameter Set: Default
Get-AzureHDInsightJobOutput [-Cluster] <String> [[-Subscription] <String> ] -JobId <String> [-Certificate <X509Certificate2> ] [-DownloadTaskLogs] [-Endpoint <Uri> ] [-HostedService <String> ] [-StandardError] [-StandardOutput] [-TaskLogsDirectory <String> ] [-TaskSummary] [ <CommonParameters>]

Detailed Description

Retrieves various types of job logs including Standard Output, Standard Error, Task logs, and a summary of the task logs.

This topic describes the cmdlet in the 0.8.1 version of the Microsoft Azure PowerShell module. To find out the version of the module you're using, from the Azure PowerShell console, type (get-module azure).version.

Parameters

-Certificate<X509Certificate2>

Management certificate of the Azure subscription.

Aliases	Cert
Required?	false
Position?	named
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

-Cluster<String>

Name of the cluster that ran the jobs that are being retrieved.

Aliases	ClusterName
Required?	true
Position?	1
Default Value	none
Accept Pipeline Input?	True (ByValue, ByPropertyName)
Accept Wildcard Characters?	false

-DownloadTaskLogs

Switch used to retrieve the task logs for the job.

Aliases	none
Required?	false
Position?	named
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

-Endpoint<Uri>

Specifies the endpoint to use when connecting to Azure if the endpoint is different from the default.

Aliases	none
Required?	false
Position?	named
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

-HostedService<String>

The namespace of the Azure HDInsight Service if it is different from the default.

Aliases	CloudServiceName
Required?	false
Position?	named
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

-JobId<String>

The Id of a specific job to be retrieved.

Aliases	Id
Required?	true
Position?	named
Default Value	none
Accept Pipeline Input?	True (ByValue, ByPropertyName)
Accept Wildcard Characters?	false

-StandardError

Switch used to retrieve the StdErr output of the job.

Aliases	none
Required?	false
Position?	named
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

-StandardOutput

Switch used to retrieve the SdtOut output of the job.

Aliases	none
Required?	false
Position?	named
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

-Subscription<String>

The subscription containing the HDInsight clusters to retrieve.

Aliases	Sub
Required?	false
Position?	2
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

-TaskLogsDirectory<String>

When DownloadTaksLogs switch is used this parameter specifies destination local folder where tasks logs will be downloaded.

Aliases	LogsDir
Required?	false
Position?	named
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

-TaskSummary

Switch used to retrieve task log summary

Aliases	none
Required?	false
Position?	named
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

<CommonParameters>

This cmdlet supports the common parameters: -Verbose, -Debug, -ErrorAction, -ErrorVariable, -OutBuffer, and -OutVariable. For more information, see  about_CommonParameters (https://go.microsoft.com/fwlink/p/?LinkID=113216).

Inputs

The input type is the type of the objects that you can pipe to the cmdlet.

Outputs

The output type is the type of the objects that the cmdlet emits.

Examples

Get Job Output

Retrieve the output from an HDInsight job.

PS C:\> $subid = (Get-AzureSubscription –Current).SubscriptionId$clustername = “yourcluster”$wordCountJob = New-AzureHDInsightMapReduceJobDefinition -JarFile "/example/apps/hadoop-examples.jar" -ClassName "wordcount" `   -Defines @{ "mapred.map.tasks"="3" } -Arguments "/example/data/gutenberg/davinci.txt", "/example/output/WordCount"$wordCountJob `    | Start-AzureHDInsightJob -Subscription $subid -Cluster $clustername `    | Wait-AzureHDInsightJob -Subscription $subid -WaitTimeoutInSeconds 3600 `    | Get-AzureHDInsightJobOutput -Cluster $clustername -StandardError