Azure Arc-enabled data services data collection and reporting

2024-09-19

This article describes the data that Azure Arc-enabled data services transmit to Microsoft.

Neither Azure Arc-enabled data services nor any of the applicable data services store any customer data. This applies to:

SQL Managed Instance enabled by Azure Arc
Azure Arc-enabled PostgreSQL

Azure Arc-enabled data services

Azure Arc-enabled data services may use some or all of the following products:

SQL Managed Instance enabled by Azure Arc
Azure Arc-enabled PostgreSQL
Azure Data Studio

At this time, use the insiders build of Azure Data Studio.
Azure CLI (az)

Directly connected

When a cluster is configured to be directly connected to Azure, some data is automatically transmitted to Microsoft.

The following table describes the type of data, how it is sent, and requirement.

Data category	What data is sent?	How is it sent?	Is it required?
Operational Data	Metrics and logs	Automatically, when configured to do so	No
Billing & inventory data	Inventory such as number of instances, and usage such as number of vCores consumed	Automatically	Yes
Diagnostics	Diagnostic information for troubleshooting purposes	Manually exported and provided to Microsoft Support	Only for the scope of troubleshooting and follows the standard privacy policies

Indirectly connected

When a cluster not configured to be directly connected to Azure, it does not automatically transmit operational, or billing and inventory data to Microsoft. To transmit data to Microsoft, you need to configure the export.

The following table describes the type of data, how it is sent, and requirement.

Data category	What data is sent?	How is it sent?	Is it required?
Operational Data	Metrics and logs	Manually	No
Billing & inventory data	Inventory such as number of instances, and usage such as number of vCores consumed	Manually	Yes
Diagnostics	Diagnostic information for troubleshooting purposes	Manually exported and provided to Microsoft Support	Only for the scope of troubleshooting and follows the standard privacy policies

Operational data

Operational data is collected for all database instances and for the Azure Arc-enabled data services platform itself. There are two types of operational data:

Metrics – Performance and capacity related metrics, which are collected to an Influx DB provided as part of Azure Arc-enabled data services. You can view these metrics in the provided Grafana dashboard.
Logs – Records emitted by all components including failure, warning, and informational events are collected to an OpenSearch database provided as part of Azure Arc-enabled data services. You can view the logs in the provided Kibana dashboard. Prior to the May, 2023 release, the log database used Elasticsearch. Thereafter, it uses OpenSearch.

The operational data stored locally requires built-in administrative privileges to view it in Grafana/Kibana.

The operational data does not leave your environment unless you chooses to export/upload (indirect connected mode) or automatically send (directly connected mode) the data to Azure Monitor/Log Analytics. The data goes into a Log Analytics workspace, which you control.

If the data is sent to Azure Monitor or Log Analytics, you can choose which Azure region or datacenter the Log Analytics workspace resides in. After that, access to view or copy it from other locations can be controlled by you.

Inventory data

The collected inventory data is represented by several Azure resource types. The following sections show the properties, types, and descriptions that are collected for each resource type:

Every database instance and the data controller itself will be reflected in Azure as an Azure resource in Azure Resource Manager.

There are three resource types:

SQL Managed Instance enabled by Azure Arc
Azure Arc-enabled PostgreSQL server
Data controller

The following sections show the properties, types, and descriptions that are collected and stored about each type of resource:

SQL Server - Azure Arc

Description	Property name	Property type
Computer name	name	string
SQL Server instance name	instanceName	string
SQL Server Version	version	string
SQL Server Edition	edition	string
Containing server resource ID	containerResourceId	string
Virtual cores	vCore	string
Connectivity status	status	string
SQL Server patch level	patchLevel	string
Collation	collation	string
Current version	currentVersion	string
TCP dynamic ports	tcpDynamicPorts	string
TCP static ports	tcpStaticPorts	string
Product ID	productId	string
License type	licenseType	string
Microsoft Defender status	azureDefenderStatus	string
Microsoft Defender status last updated	azureDefenderStatusLastUpdated	string
Provisioning state	provisioningState	string

The following JSON document is an example of the SQL Server - Azure Arc resource.

{
  
    "name": "SQL22-EE_PAYGTEST",
    "version": "SQL Server 2022",
    "edition": "Enterprise",
    "containerResourceId": "/subscriptions/aaaa0a0a-bb1b-cc2c-dd3d-eeeeee4e4e4e/resourcegroups/sashan-arc-eastasia/providers/Microsoft.HybridCompute/machines/SQL22-EE",
    "vCore": "8",
    "status": "Connected",
    "patchLevel": "16.0.1000.6",
    "collation": "SQL_Latin1_General_CP1_CI_AS",
    "currentVersion": "16.0.1000.6",
    "instanceName": "PAYGTEST",
    "tcpDynamicPorts": "61394",
    "tcpStaticPorts": "",
    "productId": "00488-00010-05000-AB944",
    "licenseType": "PAYG",
    "azureDefenderStatusLastUpdated": "2023-02-08T07:57:37.5597421Z",
    "azureDefenderStatus": "Protected",
    "provisioningState": "Succeeded"
}

SQL Server database - Azure Arc

Description	Property name	Property type
Database name	name	string
Collation	collationName	string
Database creation date	databaseCreationDate	System.DateTime
Compatibility level	compatibilityLevel	string
Database state	state	string
Readonly mode	isReadOnly	boolean
Recovery mode	recoveryMode	boolean
Auto close enabled	isAutoCloseOn	boolean
Auto shrink enabled	isAutoShrinkOn	boolean
Auto create stats enabled	isAutoCreateStatsOn	boolean
Auto update stats enabled	isAutoUpdateStatsOn	boolean
Remote data archive enabled	isRemoteDataArchiveEnabled	boolean
! Memory optimization enabled	isMemoryOptimizationEnabled	boolean
Encryption enabled	isEncrypted	boolean
Trustworthy mode enabled	isTrustworthyOn	boolean
Backup information	backupInformation
Provisioning state	provisioningState	string

The following JSON document is an example of the SQL Server database - Azure Arc resource.

{
    "name": "newDb80",
    "collationName": "SQL_Latin1_General_CP1_CI_AS",
    "databaseCreationDate": "2023-01-09T03:40:45Z",
    "compatibilityLevel": 150,
    "state": "Online",
    "isReadOnly": false,
    "recoveryMode": "Full",
    "databaseOptions": {
        "isAutoCloseOn": false,
        "isAutoShrinkOn": false,
        "isAutoCreateStatsOn": true,
        "isAutoUpdateStatsOn": true,
        "isRemoteDataArchiveEnabled": false,
        "isMemoryOptimizationEnabled": true,
        "isEncrypted": false,
        "isTrustworthyOn": false
    },
    "backupInformation": {},
    "provisioningState": "Succeeded"
}

Azure Arc data controller

Description	Property name	Property type
Location information	OnPremiseProperty	public: OnPremiseProperty
The raw Kubernetes information (`kubectl get datacontroller`)	K8sRaw	object
Last uploaded date from on-premises cluster	LastUploadedDate	System.DateTime
Data controller state	ProvisioningState	string

The following JSON document is an example of the Azure Arc Data Controller resource.

{
    "id": "/subscriptions/bbbb1b1b-cc2c-dd3d-ee4e-ffffff5f5f5f/resourceGroups/contoso-rg/providers/Microsoft.AzureArcData/dataControllers/contosodc",
    "name": "contosodc",
    "type": "microsoft.azurearcdata/datacontrollers",
    "location": "eastus",
    "extendedLocation": {
        "name": "/subscriptions/bbbb1b1b-cc2c-dd3d-ee4e-ffffff5f5f5f/resourceGroups/contoso-rg/providers/Microsoft.ExtendedLocation/customLocations/contoso",
        "type": "CustomLocation"
    },
    "tags": {},
    "systemData": {
        "createdBy": "contosouser@contoso.com",
        "createdByType": "User",
        "createdAt": "2023-01-03T21:35:36.8412132Z",
        "lastModifiedBy": "319f651f-7ddb-4fc6-9857-7aef9250bd05",
        "lastModifiedByType": "Application",
        "lastModifiedAt": "2023-02-15T17:13:26.6429039Z"
    },
    "properties": {
        "infrastructure": "azure",
        "onPremiseProperty": {
            "id": "4eb0a7a5-5ed6-4463-af71-12590b2fad5d",
            "publicSigningKey": "MIIDWzCCAkOgAwIBAgIIA8OmTJKpD8AwDQYJKoZIhvcNAQELBQAwKDEmMCQGA1UEAxMdQ2x1c3RlciBDZXJ0aWZpY2F0ZSBBdXRob3JpdHkwHhcNMjMwMTAzMjEzNzUxWhcNMjgwMTAyMjEzNzUxWjAaMRgwFgYDVQQDEw9iaWxsaW5nLXNpZ25pbmcwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC3rAuXaXIeaipFiqGW5rtkdq/1+S58CRMEkANHvwFnimXEWIt8VnbG9foIm20r0RK+6XeRpn5r92jrOl/3R4Q9AAiF3Tgzy3NF9Dg9OsKo1bnrfWHMxmyX2w8TxyZSvWKEUVpVhjhqyhy/cqSJA5ASjEtthMx4Q1HTVcEDSTfnPHPz9EhfZqZ6ES3Yqun2D9MIatkSUpjHJbqYwRTzzrsPG84hJX7EGAWntvEzzCjmTUsouShEwUhi8c05CLBwzF5bxDNLhTdy+tj2ZyUzL7R+BmifwPR9jvOziYPlrbgIIs77sPbNlZjZvMeeBaJHktWZ0s8/UpUpV1W69m7hT2gbAgMBAAGjgZYwgZMwIAYDVR0lAQH/BBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMBMA4GA1UdDwEB/wQEAwIFoDBfBgNVHREEWDBWgg5jb250cm9sbGVyLXN2Y4IoY29udHJvbGxlci1zdmMuY29udG9zby5zdmMuY2x1c3Rlci5sb2NhbIIaY29udHJvbGxlci1zdmMuY29udG9zby5zdmMwDQYJKoZIhvcNAQELBQADggEBADcZNIZcDDUC79ElbRrXdbHo9bUUv/NJfY7Dx226jc8j0AdDq8MbHAnt+JiMH6+GDb88avleA448yZ9ujBP9zC8v8IyaWu4vQpPT7MagzlsAhb6VEWU0FQfM6R14WwbATWSOIwDlMn4I33mZULyJdZhk4TqzqTQ8F0I3TavHh8TWBbjnwg1IhR/8TQ9HfgceoI80SBE3BDI5at/CzYgoWcWS2pzfd3QYwD8DIPVLCdcx1LNSDjdlQCQTKal0yKMauGIzMuYpCF1M6Z0LunPU/Ns96T9mqLXJHu+wmAoJ2CwdXa4FruwTSgrQlY3pokjTMwGaP3uzpnCSI7ykvi5kp4Q=",
            "signingCertificateThumbprint": "8FB48D0DD44DCFB25ECC13B9CB5F493F5438D38C"
        },
        "k8sRaw": {
            "kind": "DataController",
            "spec": {
                "credentials": {
                    "dockerRegistry": "arc-private-registry",
                    "domainServiceAccount": "domain-service-account-secret",
                    "serviceAccount": "sa-arc-controller"
                },
                "security": {
                    "allowDumps": true,
                    "allowNodeMetricsCollection": true,
                    "allowPodMetricsCollection": true
                },
                "services": [
                    {
                        "name": "controller",
                        "port": 30080,
                        "serviceType": "LoadBalancer"
                    }
                ],
                "settings": {
                    "ElasticSearch": {
                        "vm.max_map_count": "-1"
                    },
                    "azure": {
                        "autoUploadMetrics": "true",
                        "autoUploadLogs": "false",
                        "subscription": "bbbb1b1b-cc2c-dd3d-ee4e-ffffff5f5f5f",
                        "resourceGroup": "contoso-rg",
                        "location": "eastus",
                        "connectionMode": "direct"
                    },
                    "controller": {
                        "logs.rotation.days": "7",
                        "logs.rotation.size": "5000",
                        "displayName": "contosodc"
                    }
                },
                "storage": {
                    "data": {
                        "accessMode": "ReadWriteOnce",
                        "className": "managed-premium",
                        "size": "15Gi"
                    },
                    "logs": {
                        "accessMode": "ReadWriteOnce",
                        "className": "managed-premium",
                        "size": "10Gi"
                    }
                },
                "infrastructure": "azure",
                "docker": {
                    "registry": "mcr.microsoft.com",
                    "imageTag": "v1.14.0_2022-12-13",
                    "repository": "arcdata",
                    "imagePullPolicy": "Always"
                }
            },
            "metadata": {
                "namespace": "contoso",
                "name": "contosodc",
                "annotations": {
                    "management.azure.com/apiVersion": "2022-03-01-preview",
                    "management.azure.com/cloudEnvironment": "AzureCloud",
                    "management.azure.com/correlationId": "aaaa0000-bb11-2222-33cc-444444dddddd",
                    "management.azure.com/customLocation": "/subscriptions/bbbb1b1b-cc2c-dd3d-ee4e-ffffff5f5f5f/resourceGroups/contoso-rg/providers/Microsoft.ExtendedLocation/customLocations/contoso",
                    "management.azure.com/location": "eastus",
                    "management.azure.com/operationId": "265b98a7-0fc2-4dce-9cef-26f9b6dd000c*705EDFCA81D01028EFA1C3E9CB3CEC2BF472F25894ACB2FFDF955711236F486D",
                    "management.azure.com/resourceId": "/subscriptions/bbbb1b1b-cc2c-dd3d-ee4e-ffffff5f5f5f/resourceGroups/contoso-rg/providers/Microsoft.AzureArcData/dataControllers/contosodc",
                    "management.azure.com/systemData": "{\"createdBy\":\"9c1a17be-338f-4b3c-90e9-55eb526c5aef\",\"createdByType\":\"User\",\"createdAt\":\"2023-01-03T21:35:36.8412132Z\",\"resourceUID\":\"74087467-4f98-4a23-bacf-a1e40404457f\"}",
                    "management.azure.com/tenantId": "aaaabbbb-0000-cccc-1111-dddd2222eeee",
                    "traceparent": "00-197d885376f938d6138babf8ed4d809c-1a584b84b3c8f5df-01"
                },
                "creationTimestamp": "2023-01-03T21:35:42Z",
                "generation": 2,
                "resourceVersion": "15446366",
                "uid": "4eb0a7a5-5ed6-4463-af71-12590b2fad5d"
            },
            "apiVersion": "arcdata.microsoft.com/v5",
            "status": {
                "observedGeneration": 2,
                "state": "Ready",
                "azure": {
                    "uploadStatus": {
                        "logs": {
                            "lastUploadTime": "0001-01-01T00:00:00Z",
                            "message": "Automatic upload of logs is disabled. Execution time: 02/15/2023 17:07:57"
                        },
                        "metrics": {
                            "lastUploadTime": "2023-02-15T17:00:57.047934Z",
                            "message": "Success"
                        },
                        "usage": {
                            "lastUploadTime": "2023-02-15T17:07:53.843439Z",
                            "message": "Success. Records uploaded: 1."
                        }
                    }
                },
                "lastUpdateTime": "2023-02-15T17:07:57.587925Z",
                "runningVersion": "v1.14.0_2022-12-13",
                "arcDataServicesK8sExtensionLatestVersion": "v1.16.0",
                "registryVersions": {
                    "available": [
                        "v1.16.0_2023-02-14",
                        "v1.15.0_2023-01-10"
                    ],
                    "behind": 2,
                    "current": "v1.14.0_2022-12-13",
                    "latest": "v1.16.0_2023-02-14",
                    "next": "v1.15.0_2023-01-10",
                    "previous": "v1.13.0_2022-11-08"
                }
            }
        },
        "provisioningState": "Succeeded"
    }
}

PostgreSQL server - Azure Arc

Description	Property name	Property type
The data controller ID	DataControllerId	string
The instance admin name	Admin	string
Username and password for basic authentication	BasicLoginInformation	public: BasicLoginInformation
The raw Kubernetes information (`kubectl get postgres12`)	K8sRaw	object
Last uploaded date from on premises cluster	LastUploadedDate	System.DateTime
Group provisioning state	ProvisioningState	string

SQL managed instance - Azure Arc

Description	Property name	Property type
The managed instance ID	DataControllerId	string
The instance admin username	Admin	string
The instance start time	StartTime	string
The instance end time	EndTime	string
The raw kubernetes information (`kubectl get sqlmi`)	K8sRaw	object
Username and password for basic authentication	BasicLoginInformation	BasicLoginInformation
Last uploaded date from on-premises cluster	LastUploadedDate	System.DateTime
SQL managed instance provisioning state	ProvisioningState	string

The following JSON document is an example of the SQL Managed Instance - Azure Arc resource.


{
    "id": "/subscriptions/bbbb1b1b-cc2c-dd3d-ee4e-ffffff5f5f5f/resourceGroups/contoso-rg/providers/Microsoft.AzureArcData/sqlManagedInstances/sqlmi1",
    "name": "sqlmi1",
    "type": "microsoft.azurearcdata/sqlmanagedinstances",
    "sku": {
        "name": "vCore",
        "tier": "BusinessCritical"
    },
    "location": "eastus",
    "extendedLocation": {
        "name": "/subscriptions/bbbb1b1b-cc2c-dd3d-ee4e-ffffff5f5f5f/resourcegroups/contoso-rg/providers/microsoft.extendedlocation/customlocations/contoso",
        "type": "CustomLocation"
    },
    "tags": {},
    "systemData": {
        "createdBy": "contosouser@contoso.com",
        "createdByType": "User",
        "createdAt": "2023-01-04T01:33:57.5232885Z",
        "lastModifiedBy": "319f651f-7ddb-4fc6-9857-7aef9250bd05",
        "lastModifiedByType": "Application",
        "lastModifiedAt": "2023-02-15T01:39:11.6582399Z"
    },
    "properties": {
        "dataControllerId": "/subscriptions/bbbb1b1b-cc2c-dd3d-ee4e-ffffff5f5f5f/resourceGroups/contoso-rg/providers/Microsoft.AzureArcData/dataControllers/contosodc",
        "admin": "sqladmin",
        "k8sRaw": {
            "spec": {
                "scheduling": {
                    "default": {
                        "resources": {
                            "requests": {
                                "cpu": "2",
                                "memory": "4Gi"
                            },
                            "limits": {
                                "cpu": "2",
                                "memory": "4Gi"
                            }
                        }
                    }
                },
                "replicas": 2,
                "dev": true,
                "services": {
                    "primary": {
                        "type": "LoadBalancer"
                    },
                    "readableSecondaries": {}
                },
                "readableSecondaries": 1,
                "syncSecondaryToCommit": 0,
                "storage": {
                    "data": {
                        "volumes": [
                            {
                                "size": "5Gi"
                            }
                        ]
                    },
                    "logs": {
                        "volumes": [
                            {
                                "size": "5Gi"
                            }
                        ]
                    },
                    "datalogs": {
                        "volumes": [
                            {
                                "size": "5Gi"
                            }
                        ]
                    },
                    "backups": {
                        "volumes": [
                            {
                                "className": "azurefile",
                                "size": "5Gi"
                            }
                        ]
                    }
                },
                "security": {
                    "adminLoginSecret": "sqlmi1-login-secret"
                },
                "tier": "BusinessCritical",
                "update": {},
                "backup": {
                    "retentionPeriodInDays": 7
                },
                "licenseType": "LicenseIncluded",
                "orchestratorReplicas": 1,
                "parentResource": {
                    "apiGroup": "arcdata.microsoft.com",
                    "kind": "DataController",
                    "name": "contosodc",
                    "namespace": "contoso"
                },
                "settings": {
                    "collation": "SQL_Latin1_General_CP1_CI_AS",
                    "language": {
                        "lcid": 1033
                    },
                    "network": {
                        "forceencryption": 0,
                        "tlsciphers": "ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384",
                        "tlsprotocols": "1.2"
                    },
                    "sqlagent": {
                        "enabled": false
                    },
                    "timezone": "UTC"
                }
            },
            "metadata": {
                "annotations": {
                    "management.azure.com/apiVersion": "2022-03-01-preview",
                    "management.azure.com/cloudEnvironment": "AzureCloud",
                    "management.azure.com/correlationId": "bbbb1111-cc22-3333-44dd-555555eeeeee",
                    "management.azure.com/customLocation": "/subscriptions/bbbb1b1b-cc2c-dd3d-ee4e-ffffff5f5f5f/resourceGroups/contoso-rg/providers/microsoft.extendedlocation/customlocations/contoso",
                    "management.azure.com/location": "eastus",
                    "management.azure.com/operationId": "dbf2e708-78da-4762-8fd5-75ba43721b24*4C234309E6735F28E751F5734D64E8F98A910A88E54A1AD35C6469BCD0E6EA84",
                    "management.azure.com/resourceId": "/subscriptions/bbbb1b1b-cc2c-dd3d-ee4e-ffffff5f5f5f/resourceGroups/contoso-rg/providers/Microsoft.AzureArcData/sqlManagedInstances/sqlmi1",
                    "management.azure.com/systemData": "{\"createdBy\":\"9c1a17be-338f-4b3c-90e9-55eb526c5aef\",\"createdByType\":\"User\",\"createdAt\":\"2023-01-04T01:33:57.5232885Z\",\"resourceUID\":\"40fa8b55-4b7d-4d6a-b783-043169d7fd03\"}",
                    "management.azure.com/tenantId": "aaaabbbb-0000-cccc-1111-dddd2222eeee",
                    "traceparent": "00-3c07cf4caa8b4778591b02b1bf3979ef-f2ee2c890c21ea8a-01"
                },
                "creationTimestamp": "2023-01-04T01:34:03Z",
                "generation": 1,
                "labels": {
                    "management.azure.com/resourceProvider": "Microsoft.AzureArcData"
                },
                "name": "sqlmi1",
                "namespace": "contoso",
                "resourceVersion": "15215035",
                "uid": "6d653cd8-f17e-437a-b0dc-48154164c1ad"
            },
            "status": {
                "lastUpdateTime": "2023-02-15T01:39:07.691211Z",
                "observedGeneration": 1,
                "readyReplicas": "2/2",
                "roles": {
                    "sql": {
                        "replicas": 2,
                        "lastUpdateTime": "2023-02-14T11:37:14.875705Z",
                        "readyReplicas": 2
                    }
                },
                "state": "Ready",
                "endpoints": {
                    "logSearchDashboard": "https://230.41.13.18:5601/app/kibana#/discover?_a=(query:(language:kuery,query:'custom_resource_name:sqlmi1'))",
                    "metricsDashboard": "https://230.41.13.18:3000/d/40q72HnGk/sql-managed-instance-metrics?var-hostname=sqlmi1-0",
                    "mirroring": "230.41.13.18:5022",
                    "primary": "230.41.13.18,1433",
                    "secondary": "230.41.13.18,1433"
                },
                "highAvailability": {
                    "lastUpdateTime": "2023-02-14T11:47:42.208708Z",
                    "mirroringCertificate": "-----BEGIN CERTIFICATE-----\nMIIDQzCCAiugAwIBAgIISqqmfCPaolkwDQYJKoZIhvcNAQELBQAwKDEmMCQGA1UEAxMdQ2x1c3Rl\r\nciBDZXJ0aWZpDEzNDA2WhcNMjgwMTAzMDEzNDA2WjAO\r\nMQwwCgYDVQQDEwNkYm0wggEiMA0GCSqgEKAoIBAQDEXj2nm2cGkyfu\r\npXWQ4s6G//AI1rbH4JStZOAHwJNYmBuESSHz0i6znjnQQloFe+g2KM+1m4TN1T39Lz+/ufEYQQX9\r\nx9WuGP2IALgH1LXc/0DGuOB16QXqN7ZWULQ4ovW4Aaz5NxTSDXWYPK+zpb1c8adsQyamLHwmSPs4\r\nMpsgfOR9EUCqdnuKjSHbWCtkJTYogpAFyZb5HOgY1TMICrTkXG6VYoCPS/EDNmtPOyVuykdjjsxx\r\nIC5KkVgHWTaYIDjim7L44FPh4HUIVM/OFScRijCZTJogN/Fe94+kGDWfgWIG36Jlz127BbWV3HNJ\r\nkH2oLchIABvgTXsdKnjK3i2TAgMBAAGjgYowgYcwIAYDVR0lAQH/BBYwFAYIKwYBBQUHAwIGCCsG\r\nAQUFBwMBMA4GA1UdDwEB/wQEAwIFoDBTBgNVHREETDBKggpzcWxtaTEtc3ZjgiRzcWxtaTEtc3Zj\r\nLmNvbnRvc28uc3ZjLmNsdXN0ZXIubG9jYWyCFnNxbG1pMS1zdmMuY29udG9zby5zdmMwDQYJKoZI\r\nhvcNAQELBQADggEBAA+Wj6WK9NgX4szxT7zQxPVIn+0iviO/2dFxHmjmvj+lrAffsgNdfeX5095f\r\natxIO+no6VW2eoHze2f6AECh4/KefyAzd+GL9MIksJcMLqSqAemXju3pUfGBS1SAW8Rh361D8tmA\r\nEFpPMwZG3uMidYMso0GqO0tpejz2+5Q4NpweHBGoq6jk+9ApTLD+s5qetZHrxGD6tS1Z/Lvt24lE\r\nKtSKEDw5O2qnqbsOe6xxtPAuIfTmpwIzIv2WiGC3aGuXSr0bNyPHzh5RL1MCIpwLMrnruFwVzB25\r\nA0xRalcXVZRZ1H0zbznGsecyBRJiA+7uxNB7/V6i+SjB/qxj2xKh4s8=\n-----END CERTIFICATE-----\n",
                    "healthState": "Error",
                    "replicas": []
                },
                "logSearchDashboard": "https://230.41.13.18:5601/app/kibana#/discover?_a=(query:(language:kuery,query:'custom_resource_name:sqlmi1'))",
                "metricsDashboard": "https://230.41.13.18:3000/d/40q72HnGk/sql-managed-instance-metrics?var-hostname=sqlmi1-0",
                "primaryEndpoint": "230.41.13.18,1433",
                "runningVersion": "v1.14.0_2022-12-13",
                "registryVersions": {
                    "available": [],
                    "behind": 0,
                    "current": "v1.14.0_2022-12-13",
                    "latest": "v1.14.0_2022-12-13",
                    "previous": "v1.13.0_2022-11-08"
                }
            }
        },
        "provisioningState": "Succeeded",
        "licenseType": "LicenseIncluded"
    }
}

Examples

Example of resource inventory data JSON document that is sent to Azure to create Azure resources in your subscription.

{ 

        "customObjectName": "<resource type>-2020-29-5-23-13-17-164711", 
        "uid": "4bc3dc6b-9148-4c7a-b7dc-01afc1ef5373", 
        "instanceName": "sqlInstance001", 
        "instanceNamespace": "arc", 
        "instanceType": "<resource>", 
        "location": "eastus", 
        "resourceGroupName": "production-resources", 
        "subscriptionId": "<subscription_id>", 
        "isDeleted": false, 
        "externalEndpoint": "32.191.39.83:1433", 
        "vCores": "2", 
        "createTimestamp": "05/29/2020 23:13:17", 
        "updateTimestamp": "05/29/2020 23:13:17" 
    }

Billing data

Billing data is used for purposes of tracking usage that is billable. This data is essential for running of the service and needs to be transmitted manually or automatically in all modes.

Arc-enabled data services

Billing data captures the start time (“created”) and end time (“deleted”) of a given instance, as well as any start and time whenever a change in the number of cores available to a given instance (“core limit”) happens.

{ 
    "requestType": "usageUpload", 
    "clusterId": "4b0917dd-e003-480e-ae74-1a8bb5e36b5d", 
    "name": "DataControllerTestName", 
    "subscriptionId": "<subscription_id>", 
    "resourceGroup": "production-resources", 
    "location": "eastus", 
    "uploadRequest": { 
    "exportType": "usages", 
    "dataTimestamp": "2020-06-17T22:32:24Z", 
    "data": 
        "[{\"name\":\"sqlInstance001\", 
        \"namespace\":\"arc\", 
        \"type\":\"<resource type>\", 
        \"eventSequence\":1,  
        \"eventId\":\"50DF90E8-FC2C-4BBF-B245-CB20DC97FF24\", 
        \"startTime\":\"2020-06-17T19:11:47.7533333\", 
        \"endTime\":\"2020-06-17T19:59:00\", 
        \"quantity\":1, 
        \"id\":\"<subscription_id>\"}]", 
        "signature":"MIIE7gYJKoZIhvcNAQ...2xXqkK"

Arc-enabled SQL Server

Billing data captures a snapshot of the SQL Server instance properties as well as the machine properties every hour and compose the usage upload payload to report usage. There is a snapshot time in the payload for each SQL Server instance.

{
    "hostType": "Unknown",
    "osType": "Windows",
    "manufacturer": "Microsoft",
    "model": "Hyper-V",
    "isVirtualMachine": true,
    "serverName": "TestArcServer",
    "serverId": "<server id>",
    "location": "eastus",
    "timestamp": "2021-07-08T01:42:15.0388467Z",
    "uploadRequest": {
        "exportType": "usages",
        "dataTimestamp": "2020-06-17T22:32:24Z",
        "data": 
            "[{\"hostType\":\"VirtualMachine\",
            \"numberOfCores\":4,
            \"numberOfProcessors\":1,
            \"numberOfLogicalProcessors\":4,
            \"subscriptionId\":\"<subscription id>\",\"resourceGroup\":\"ArceeBillingPipelineStorage_Test\",
            \"location\":\"eastus2euap\",
            \"version\":\"Sql2019\",
            \"edition\":\"Enterprise\",
            \"editionOriginalString\":\"Enterprise Edition: Core based licensing\",
            \"coreInfoOriginalString\":\"using 16 logical processors based on SQL Server licensing\",
            \"vCore\":4,
            \"instanceName\":\"INSTANCE01\",
            \"licenseType\":\"LicenseOnly\",
            \"hostLicenseType\":\"Paid\",
            \"instanceLicenseType\":\"Paid\",
            \"serverName\":\"TestArcServer\",
            \"isRunning\":false,
            \"eventId\":\"00000000-0000-0000-0000-000000000000\",
            \"snapshotTime\":\"2020-06-17T19:59:00\",
            \"isAzureBilled\":\"Enabled\",
            \"hasSoftwareAssurance\":\"Undefined\"}]"
    }
}

Diagnostic data

In support situations, you may be asked to provide database instance logs, Kubernetes logs, and other diagnostic logs. The support team will provide a secure location for you to upload to. Dynamic management views (DMVs) may also provide diagnostic data. The DMVs or queries used could contain database schema metadata details but typically not customer data. Diagnostic data does not contain any passwords, cluster IPs or individually identifiable data. These are cleaned and the logs are made anonymous for storage when possible. They are not transmitted automatically and administrator has to manually upload them.

Field name	Notes
Error logs	Log files capturing errors may contain customer or personal data (see below) are restricted and shared by user
DMVs	Dynamic management views can contain query and query plans but are restricted and shared by user
Views	Views can contain customer data but are restricted and shared only by user
Crash dumps – customer data	Maximum 30-day retention of crash dumps – may contain access control data Statistics objects, data values within rows, query texts could be in customer crash dumps
Crash dumps – personal data	Machine, logins/ user names, emails, location information, customer identification – require user consent to be included

Upload usage data to Azure Monitor