Spark and Azure HDInsight Spark

Spark: The ApacheSpark.Tables function returns a table listing the tables on the Spark cluster host using protocol. Valid protocols are: SparkProtocol.Standard, SparkProtocol.HTTP.

Azure HDInsight Spark: List the tables in an Azure Spark instance.

Summary

Property Value
Connector Spark and Azure HDInsight Spark icon Spark and Azure HDInsight Spark
Products Power BI (semantic models)
Power Query Online
Release state General availability
Category Other and Azure
Authentication kinds Username / Password
Windows
Data source kind Spark
Function Reference Documentation ApacheSpark.Tables
AzureSpark.Tables
Spark.Tables

Supported capabilities

Spark

Entry point: ApacheSpark.Tables

  • DirectQuery

Azure HDInsight Spark

Entry point: AzureSpark.Tables

  • DirectQuery

Parameters

Spark

Entry point: ApacheSpark.Tables

Required parameter count: 2

Returns a table listing the tables on the specified Spark cluster.

Returns a table listing the tables on the Spark cluster host using protocol. Valid protocols are: SparkProtocol.Standard, SparkProtocol.HTTP

Parameter Display name Required Type Group Description Allowed values Sample values Nullable Additional metadata Allowed value metadata Declared allowed values
server Server Yes text Spark Server "http://example.com:10000/cliservice" false
protocol Protocol Yes number The protocol to use when connecting to an instance of Spark. 0 (Standard); 2 (HTTP) false {"Documentation.Name": "SparkProtocol.Type"} [{"Metadata": {"Documentation.Caption": "Standard", "Documentation.Name": "SparkProtocol.Standard"}, "Value": 0}, {"Metadata": {"Documentation.Caption": "HTTP", "Documentation.Name": "SparkProtocol.HTTP"}, "Value": 2}] [0, 2]
options Advanced Options No nullable record Advanced Options true

Fields in options

Field Display name Required Type Group Sample values Nullable Optional
options.BatchSize Batch Size No number Advanced Options 10000 false true
options.HierarchicalNavigation Create hierarchical navigation view No nullable logical Advanced Options true true
options.Implementation Use new implementation No text Advanced Options "1.0"; "2.0" false true

Azure HDInsight Spark

Entry point: AzureSpark.Tables

Required parameter count: 1

List the tables in an Azure Spark instance.

List the tables in an Azure Spark instance.

Parameter Display name Required Type Group Description Sample values Nullable
server Server Yes text Spark Server "contoso.azurehdinsight.net" false
options Advanced Options No nullable record Advanced Options true

Fields in options

Field Display name Required Type Group Sample values Nullable Optional
options.BatchSize Batch Size No number Advanced Options 10000 false true
options.HierarchicalNavigation Create hierarchical navigation view No nullable logical Advanced Options true true
options.Implementation Use new implementation No text Advanced Options "1.0"; "2.0" false true