StorageLevel Class

Definition

Flags for controlling the storage of an RDD. Each StorageLevel records whether to use memory, whether to drop the RDD to disk if it falls out of memory, whether to keep the data in memory in a JAVA-specific serialized format, and whether to replicate the RDD partitions on multiple nodes. Also contains static properties for some commonly used storage levels, MEMORY_ONLY.

public sealed class StorageLevel
type StorageLevel = class
Public NotInheritable Class StorageLevel
Inheritance
StorageLevel

Constructors

StorageLevel(Boolean, Boolean, Boolean, Boolean, Int32)

Properties

Deserialized

Returns bool value of Deserialized of this StorageLevel.

DISK_ONLY

Returns the StorageLevel to Disk, serialized and replicated once.

DISK_ONLY_2

Returns the StorageLevel to Disk, serialized and replicated twice.

MEMORY_AND_DISK

Returns the StorageLevel to Disk and Memory, deserialized and replicated once.

MEMORY_AND_DISK_2

Returns the StorageLevel to Disk and Memory, deserialized and replicated twice.

MEMORY_AND_DISK_SER

Returns the StorageLevel to Disk and Memory, serialized and replicated once.

MEMORY_AND_DISK_SER_2

Returns the StorageLevel to Disk and Memory, serialized and replicated twice.

MEMORY_ONLY

Returns the StorageLevel to Memory, deserialized and replicated once.

MEMORY_ONLY_2

Returns the StorageLevel to Memory, deserialized and replicated twice.

MEMORY_ONLY_SER

Returns the StorageLevel to Memory, serialized and replicated once.

MEMORY_ONLY_SER_2

Returns the StorageLevel to Memory, serialized and replicated twice.

NONE

Returns the StorageLevel object with all parameters set to false.

OFF_HEAP

Returns the StorageLevel to Disk, Memory and Offheap, serialized and replicated once.

Replication

Returns int value of Replication of this StorageLevel.

UseDisk

Returns bool value of UseDisk of this StorageLevel.

UseMemory

Returns bool value of UseMemory of this StorageLevel.

UseOffHeap

Returns bool value of UseOffHeap of this StorageLevel.

Methods

Description()

Returns the description string of this StorageLevel.

Equals(Object)

Checks if the given object is same as the current object.

GetHashCode()

Returns the hash code of the current object.

ToString()

Returns the string representation of this StorageLevel.

Applies to