Spark Batch - Get Spark Batch Job
Mendapatkan satu pekerjaan batch spark.
GET {endpoint}/livyApi/versions/{livyApiVersion}/sparkPools/{sparkPoolName}/batches/{batchId}
GET {endpoint}/livyApi/versions/{livyApiVersion}/sparkPools/{sparkPoolName}/batches/{batchId}?detailed={detailed}
Parameter URI
Nama | Dalam | Diperlukan | Jenis | Deskripsi |
---|---|---|---|---|
batch
|
path | True |
integer int32 |
Pengidentifikasi untuk pekerjaan batch. |
endpoint
|
path | True |
string |
Titik akhir pengembangan ruang kerja, misalnya |
livy
|
path | True |
string |
Versi api yang valid untuk permintaan. |
spark
|
path | True |
string |
Nama kumpulan spark. |
detailed
|
query |
boolean |
Param kueri opsional yang menentukan apakah respons terperinci dikembalikan di luar livy biasa. |
Respons
Nama | Jenis | Deskripsi |
---|---|---|
200 OK |
Berhasil |
Contoh
Gets a single spark batch job.
Permintaan sampel
GET myWorkspace.dev.azuresynapse.net/livyApi/versions/2020-12-01/sparkPools/mySparkPool/batches/123?detailed=True
Respon sampel
{
"livyInfo": null,
"name": "jobname",
"workspaceName": "myWorkspace",
"sparkPoolName": "mySparkPool",
"submitterName": "thetime",
"submitterId": "thesubmitterid",
"artifactId": "fill in here",
"jobType": "SparkBatch",
"result": "Failed",
"schedulerInfo": null,
"pluginInfo": null,
"errorInfo": [],
"tags": null,
"id": 1,
"appId": "fill in here",
"appInfo": null,
"state": "the state",
"log": []
}
Definisi
Nama | Deskripsi |
---|---|
Livy |
Status batch |
Plugin |
|
Scheduler |
|
Spark |
|
Spark |
Hasil pekerjaan batch Spark. |
Spark |
|
Spark |
|
Spark |
Jenis pekerjaan. |
Spark |
|
Spark |
|
Spark |
|
Spark |
LivyStates
Status batch
Nama | Jenis | Deskripsi |
---|---|---|
busy |
string |
|
dead |
string |
|
error |
string |
|
idle |
string |
|
killed |
string |
|
not_started |
string |
|
recovering |
string |
|
running |
string |
|
shutting_down |
string |
|
starting |
string |
|
success |
string |
PluginCurrentState
Nama | Jenis | Deskripsi |
---|---|---|
Cleanup |
string |
|
Ended |
string |
|
Monitoring |
string |
|
Preparation |
string |
|
Queued |
string |
|
ResourceAcquisition |
string |
|
Submission |
string |
SchedulerCurrentState
Nama | Jenis | Deskripsi |
---|---|---|
Ended |
string |
|
Queued |
string |
|
Scheduled |
string |
SparkBatchJob
Nama | Jenis | Deskripsi |
---|---|---|
appId |
string |
Id aplikasi sesi ini |
appInfo |
object |
Info aplikasi terperinci. |
artifactId |
string |
Pengidentifikasi artefak. |
errorInfo |
Informasi kesalahan. |
|
id |
integer |
Id sesi. |
jobType |
Jenis pekerjaan. |
|
livyInfo | ||
log |
string[] |
Baris log. |
name |
string |
Nama batch. |
pluginInfo |
Informasi plugin. |
|
result |
Hasil pekerjaan batch Spark. |
|
schedulerInfo |
Informasi penjadwal. |
|
sparkPoolName |
string |
Nama kumpulan Spark. |
state |
Status batch |
|
submitterId |
string |
Pengidentifikasi pengirim. |
submitterName |
string |
Nama pengirim. |
tags |
object |
Tag. |
workspaceName |
string |
Nama ruang kerja. |
SparkBatchJobResultType
Hasil pekerjaan batch Spark.
Nama | Jenis | Deskripsi |
---|---|---|
Cancelled |
string |
|
Failed |
string |
|
Succeeded |
string |
|
Uncertain |
string |
SparkBatchJobState
Nama | Jenis | Deskripsi |
---|---|---|
currentState |
string |
status pekerjaan Spark. |
deadAt |
string |
waktu di mana "mati" negara livy pertama kali terlihat. |
jobCreationRequest | ||
killedAt |
string |
waktu ketika "membunuh" negara livy pertama kali terlihat. |
notStartedAt |
string |
waktu ketika status livy "not_started" pertama kali terlihat. |
recoveringAt |
string |
waktu ketika "memulihkan" status livy pertama kali terlihat. |
runningAt |
string |
waktu ketika status livy "berjalan" pertama kali terlihat. |
startingAt |
string |
waktu saat "memulai" status livy pertama kali terlihat. |
successAt |
string |
waktu ketika status livy "sukses" pertama kali terlihat. |
SparkErrorSource
Nama | Jenis | Deskripsi |
---|---|---|
Dependency |
string |
|
System |
string |
|
Unknown |
string |
|
User |
string |
SparkJobType
Jenis pekerjaan.
Nama | Jenis | Deskripsi |
---|---|---|
SparkBatch |
string |
|
SparkSession |
string |
SparkRequest
Nama | Jenis | Deskripsi |
---|---|---|
archives |
string[] |
|
args |
string[] |
|
className |
string |
|
conf |
object |
|
driverCores |
integer |
|
driverMemory |
string |
|
executorCores |
integer |
|
executorMemory |
string |
|
file |
string |
|
files |
string[] |
|
jars |
string[] |
|
name |
string |
|
numExecutors |
integer |
|
pyFiles |
string[] |
SparkScheduler
Nama | Jenis | Deskripsi |
---|---|---|
cancellationRequestedAt |
string |
|
currentState | ||
endedAt |
string |
|
scheduledAt |
string |
|
submittedAt |
string |
SparkServiceError
Nama | Jenis | Deskripsi |
---|---|---|
errorCode |
string |
|
message |
string |
|
source |
SparkServicePlugin
Nama | Jenis | Deskripsi |
---|---|---|
cleanupStartedAt |
string |
|
currentState | ||
monitoringStartedAt |
string |
|
preparationStartedAt |
string |
|
resourceAcquisitionStartedAt |
string |
|
submissionStartedAt |
string |