recentProgress (StreamingQuery)

Returns an array of the most recent StreamingQueryProgress updates for this query. The number of progress updates retained is configured by spark.sql.streaming.numRecentProgressUpdates.

Returns

list of StreamingQueryProgress

Examples

sdf = spark.readStream.format("rate").load()
sq = sdf.writeStream.format('memory').queryName('this_query').start()
sq.recentProgress
# [...]
sq.stop()