RxHdfsFileSystem: RevoScaleR HDFS File System object generator

Artikel
07/12/2022

Description

This is the main generator for RxHdfsFileSystem S3 class.

Usage

    RxHdfsFileSystem( object, hostName = rxGetOption("hdfsHost"), port = rxGetOption("hdfsPort"), useWebHdfs = FALSE, oAuthParameters = NULL, verbose = FALSE )

     ## S3 method for class `RxHdfsFileSystem':
print  ( x, ... )

Arguments

`object`

object of class RxHdfsFileSystem. This argument is optional. If supplied, the values of the other arguments are used to replace those of object and the modified object is returned. If these arguments are not supplied, they will take their default values.

`hostName`

character string specifying name of host for HDFS file system.

`port`

integer specifying port number.

`useWebHdfs`

NOT YET IMPLEMENTED Optional Flag indicating whether this is a HDFS or a WebHdfs interface - default FALSE

`oAuthParameters`

NOT YET IMPLEMENTED Optional list of OAuth2 parameters created using rxOAuthParameters function (valid only if useWebHdfs is TRUE) - default NULL

`verbose`

Optional Flag indicating "verbose" mode for WebHdfs HTTP calls (valid only if useWebHdfs is TRUE) - default FALSE

`x`

an RxHdfsFileSystem object.

`...`

other arguments are passed to the underlying function.

Details

Writing to the HDFS file system can only be done using a RxHadoopMR compute context with an RxXdfData data source. The 'rxHadoop' commands, such as rxHadoopCopy, can also be used to manipulate data sets in HDFS.

Value

An RxHdfsFileSystem file system object. This object may be used to in rxSetFileSystem, rxOptions, RxTextData, or RxXdfData to set the file system.

Author(s)

Microsoft Corporation Microsoft Technical Support

Examples


 # Setup to run analyses to use HDFS file system
 ## Not run:

myHdfsFileSystem <- RxHdfsFileSystem(hostName = "myHost", port = 8020)
rxSetFileSystem(fileSystem = myHdfsFileSystem )
## End(Not run)

Delen via