Share via

DataFrameWriter.BucketBy(Int32, String, String[]) Method

  • Reference

Definition

Namespace:
Microsoft.Spark.Sql
Assembly:
Microsoft.Spark.dll
Package:
Microsoft.Spark v1.0.0

Buckets the output by the given columns. If specified, the output is laid out on the file system similar to Hive's bucketing scheme.

public Microsoft.Spark.Sql.DataFrameWriter BucketBy (int numBuckets, string colName, params string[] colNames);
member this.BucketBy : int * string * string[] -> Microsoft.Spark.Sql.DataFrameWriter
Public Function BucketBy (numBuckets As Integer, colName As String, ParamArray colNames As String()) As DataFrameWriter

Parameters

numBuckets
Int32

Number of buckets to save

colName
String

A column name

colNames
String[]

Additional column names

Returns

DataFrameWriter

This DataFrameWriter object

Applies to