DataFrameWriterV2 Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Interface used to write a DataFrame to external storage using the v2 API.
[Microsoft.Spark.Since("3.0.0")]
public sealed class DataFrameWriterV2[<Microsoft.Spark.Since("3.0.0")>]
type DataFrameWriterV2 = classPublic NotInheritable Class DataFrameWriterV2- Inheritance
-
DataFrameWriterV2
- Attributes
Methods
| Append() |
Append the contents of the data frame to the output table. |
| Create() |
Create a new table from the contents of the data frame. |
| CreateOrReplace() |
Create a new table or replace an existing table with the contents of the data frame. |
| Option(String, Boolean) |
Adds an output option for the underlying data source. |
| Option(String, Double) |
Adds an output option for the underlying data source. |
| Option(String, Int64) |
Adds an output option for the underlying data source. |
| Option(String, String) |
Adds an output option for the underlying data source. |
| Options(Dictionary<String,String>) |
Adds output options for the underlying data source. |
| Overwrite(Column) |
Overwrite rows matching the given filter condition with the contents of the data frame in the output table. |
| OverwritePartitions() |
Overwrite all partition for which the data frame contains at least one row with the contents of the data frame in the output table. |
| PartitionedBy(Column, Column[]) |
Partition the output table created by Create(), CreateOrReplace(), or Replace() using the given columns or transforms. |
| Replace() |
Replace an existing table with the contents of the data frame. |
| TableProperty(String, String) |
Add a table property. |
| Using(String) |
Specifies a provider for the underlying output data source. Spark's default catalog supports "parquet", "json", etc. |