Edit

Administration resources for SQL Server 2019 Big Data Clusters

  • Article

Applies to: SQL Server 2019 (15.x)

Important

The Microsoft SQL Server 2019 Big Data Clusters add-on will be retired. Support for SQL Server 2019 Big Data Clusters will end on February 28, 2025. All existing users of SQL Server 2019 with Software Assurance will be fully supported on the platform and the software will continue to be maintained through SQL Server cumulative updates until that time. For more information, see the announcement blog post and Big data options on the Microsoft SQL Server platform.

This article explains how to view the status of a big data cluster by using Azure Data Studio, notebooks, and Azure Data CLI azdata commands.

Know your architecture

Starting with SQL Server 2019 (15.x), SQL Server Big Data Clusters allow you to deploy scalable clusters of SQL Server, Spark, and HDFS containers that run on Kubernetes. For an overview, see What are SQL Server Big Data Clusters?

SQL Server Big Data Clusters provide coherent and consistent authorization and authentication. For an overview of Big Data Cluster security, see Security concepts for SQL Server Big Data Clusters.

Manage and operate with tools

The following articles describe how to manage and operate Big Data Clusters:

Monitor with tools

The following articles describe how to monitor Big Data Clusters:

Important

The Internet Explorer browser and older Microsoft Edge browsers aren't compatible with Grafana or Kibana. Consider the Chromium-based Microsoft Edge, or see supported browsers for Grafana or supported browsers for Kibana.

Monitor and inspect logs by using notebooks

The following articles list many of the Jupyter Notebooks that are available in Azure Data Studio:

Where to find SQL Server Big Data Clusters administration notebooks

SQL Server Big Data Clusters provide a comprehensive administration experience by using Jupyter Notebooks. The provided notebooks cover cluster operations, management, monitoring, logging, and troubleshooting.

  1. To add the operational notebook repository from GitHub to Azure Data Studio, you can use keyboard shortcut Ctrl+Shift+P or select View, and then Command Palette. Select Add Remote Book.

  2. In the Add Remote Book dialog box, select the desired latest version for operational notebooks. Select Add, as shown below:

    Screenshot that shows the Azure Data Studio palette.

  3. Select Jupyter Books: Add Remote Book. A window opens that allows you to select a notebook.

    Note

    Make sure you select the correct notebook version. It should match the cumulative update version of your big data cluster.

  4. Select the version of the notebooks base on the cumulative update of your big data cluster:

    Screenshot that shows how to add a remote notebook.

  5. When you select Add, you gain access to all the notebooks for your chosen version on the Notebooks tab of Azure Data Studio:

    Screenshot that shows the notebooks for a specific version.

How to use these notebooks

To learn how to use the notebooks, see these articles:

Big Data Clusters troubleshooting resources

The following articles describe how to troubleshoot Big Data Clusters:

The following articles describe how to troubleshoot big data clusters deployed in Active Directory mode:

Next step

Manage SQL Server Big Data Clusters with Azure Data Studio notebooks