DataFrame.ToLocalIterator Method
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Overloads
| ToLocalIterator(Boolean) |
Returns an iterator that contains all of the rows in this |
| ToLocalIterator() |
Returns an iterator that contains all of the rows in this |
ToLocalIterator(Boolean)
Returns an iterator that contains all of the rows in this DataFrame.
The iterator will consume as much memory as the largest partition in this DataFrame.
With prefetch it may consume up to the memory of the 2 largest partitions.
[Microsoft.Spark.Since("3.0.0")]
public System.Collections.Generic.IEnumerable<Microsoft.Spark.Sql.Row> ToLocalIterator (bool prefetchPartitions);[<Microsoft.Spark.Since("3.0.0")>]
member this.ToLocalIterator : bool -> seq<Microsoft.Spark.Sql.Row>Public Iterator Function ToLocalIterator (prefetchPartitions As Boolean) As IEnumerable(Of Row)Parameters
- prefetchPartitions
- Boolean
If Spark should pre-fetch the next partition before it is needed.
Returns
Row objects
- Attributes
Applies to
ToLocalIterator()
Returns an iterator that contains all of the rows in this DataFrame.
The iterator will consume as much memory as the largest partition in this DataFrame.
public System.Collections.Generic.IEnumerable<Microsoft.Spark.Sql.Row> ToLocalIterator ();member this.ToLocalIterator : unit -> seq<Microsoft.Spark.Sql.Row>Public Function ToLocalIterator () As IEnumerable(Of Row)Returns
Row objects