clearCache

Removes all cached tables from the in-memory cache.

Syntax

clearCache()

Notes

Cached data is shared across all Spark sessions on the cluster, so clearing the cache affects all sessions.

Examples

_ = spark.sql("DROP TABLE IF EXISTS tbl1")
_ = spark.sql("CREATE TABLE tbl1 (name STRING, age INT) USING parquet")
spark.catalog.clearCache()
spark.catalog.isCached("tbl1")
# False
_ = spark.sql("DROP TABLE tbl1")