Link HDInsight Cluster in VSCode to Show Hive Tables

Question

Dear All

I am using the latest release of VSCode 1.48.2 to connect to my HDInsight Spark Cluster (HDI 3.6, Spark 2.3).

It successfully lists the Hive Databases available in my cluster when I browse to the 'Hive Databases' section insight the HDInsight section. It also successfully lists the tables inside the Hive databases.

However, it continuously shows errors of this sort as soon as I want to list a table's columns:

Element with id /subscriptions/21560617-5db1-4347-a7d1-abcdefghijk/prdupcchbisp1/Hive Databases/lift_and_shift_curated/vod_product/ : NULL is already registered

I can succesfully query these tables, but it just does not show me the columns.

Any ideas about how to tackle this issue are highly appreciated.

BR, Christoph

Answer 1

Hi @PRADEEPCHEEKATLA-MSFT

Steps to reproduce:

• Start VS Code
• Link HDInsight cluster (as explained in the docu)
• List clusters for verification

21560617-5db1-4347-a7d1-648fe8e39d5d prdupcchbisp1 Spark(Version: 2.3) Running

• Browse to Hive Databases
• Enter user credentials when asked (it's an ESP cluster just to mention)
• Go to, for example, the lift_and_shift_curated database and browse it
• It lists all tables in this db
• Intend to show columns for a particular table, for instance, the 'channel' table
• The error is shown in the bottom right corner of VSCode and the columns are NOT listed.

Is that information sufficient to proceed?

BR, Christoph