isNaN

Check if the column value is NaN.

Syntax

isNaN()

Returns

Column (boolean)

Examples

from pyspark.sql import Row
df = spark.createDataFrame(
    [Row(name='Tom', height=80.0), Row(name='Alice', height=float('nan'))])
df.filter(df.height.isNaN()).collect()

# [Row(name='Alice', height=nan)]