rxGetInfo: Get Data Source Information
Get basic information about an RevoScaleR data source or data frame
rxGetInfo(data, getVarInfo = FALSE, getBlockSizes = FALSE,
getValueLabels = NULL, varsToKeep = NULL, varsToDrop = NULL,
startRow = 1, numRows = 0, computeInfo = FALSE,
allNodes = TRUE, verbose = 0)
a data frame, a character string specifying an .xdf, or an RxDataSource object. If a local compute context is being used, this argument may also be a list of data sources, in which case the output will be returned in a named list. See the details section for more information.
logical value. If TRUE
, variable information is returned.
logical value. If TRUE
, block sizes are returned in the output for an .xdf file, and when printed the first 10 block sizes are shown.
logical value. If TRUE
and getVarInfo
is TRUE
or NULL
, factor value labels are included in the output.
character vector of variable names for which information is returned. If NULL
or getVarInfo
is FALSE
, argument is ignored. Cannot be used with varsToDrop
.
character vector of variable names for which information is not returned. If NULL
or getVarInfo
is FALSE
, argument is ignored. Cannot be used with varsToKeep
.
starting row for retrieval of data if a data frame or .xdf file.
number of rows of data to retrieve if a data frame or .xdf file.
logical value. If TRUE
, and getVarInfo
is TRUE
, variable information (e.g., high/low values) for non-xdf data sources will be computed by reading through the data set. If TRUE
, and getVarInfo
is FALSE
, the number of variables will be gotten from from non-xdf data sources (but not the number of rows).
logical value. Ignored if the active RxComputeContext compute context is local or RxForeachDoPar
. Otherwise, if TRUE
, a list containing the information for the data set on each node in the active compute context will be returned. If FALSE
, only information on the data set on the master node will be returned. Note that the determination of the master node is not controlled by the end user. See the RevoScaleR Distributed Computing Guide for more information on master node computations.
integer value. If 0
, no additional output is printed. If 1
, additional summary information is printed for an .xdf file.
If a local compute context is being used, the data
and file
arguments may be a list of data source objects, e.g.,
data = list(iris, airquality, attitude)
,
in which case a named list of results are returned. For rxGetInfo
, a mix of supported data sources
is allowed. Note that data
frames should not be specified in quotes because, in that case, they will be interpreted as .xdf data paths.
If the RxComputeContext is distributed, rxGetInfo
will request information from the
compute context nodes.
list containing the following possible elements:
character string containing the file name and path (if an .xdf file).
character string containing object name (if not an .xdf file).
class of the object if an R object.
length of the object if it is not an .xdf file or data frame.
number of composite data files(if a composite .xdf file).
number of rows in the data set.
number of variables in the data set.
number of blocks in the data set.
list of variable information where each element is a list describing a variable. (See return value of rxGetVarInfo for more information.)
integer vector containing number of rows in each block (if getBlockSizes
is set to TRUE
). Set to NULL
if data
is a data frame.
data frame containing the data (if numRows > 0
)
If using a distributed compute context with the allNodes
set to TRUE
,
a list of lists with information on the data from each node will be returned.
Microsoft Corporation Microsoft Technical Support
rxDataStep, rxGetVarInfo, rxSetVarInfo.
# Summary information about a data frame
fileInfo <- rxGetInfo(data = iris, numRows = 5)
fileInfo
# Summary information about an .xdf file
mortFile <- file.path(rxGetOption("sampleDataDir"), "CensusWorkers")
infoObj <- rxGetInfo(mortFile, getBlockSizes=TRUE)
numBlocks <- infoObj$numBlocks
aveRowsPerBlock <- infoObj$numRows/numBlocks
rowsPerBlock <- infoObj$rowsPerBlock
aveRowsPerBlock1 <- mean(rowsPerBlock)
# Obtain information on a variety of data sources
fourthGradersXDF <- file.path(rxGetOption("sampleDataDir"), "fourthgraders.xdf")
KyphosisDS <- RxXdfData(file.path(rxGetOption("sampleDataDir"), "kyphosis.xdf"))
claimsTxtDS <- RxTextData(file.path(rxGetOption("sampleDataDir"), "claims.txt"))
rxGetInfo(data = list(iris, fourthGradersXDF, KyphosisDS, claimsTxtDS))