Import JSON documents into SQL Server
Applies to:
SQL Server 2016 (13.x) and later
Azure SQL Database
Azure SQL Managed Instance
This article describes how to import JSON files into SQL Server. JSON documents store many types of data, for example, application logs, sensor data, and so forth. It's important to be able to read the JSON data stored in files, load the data into SQL Server, and analyze it.
The examples in this article use a JSON file from a GitHub sample containing a list of books.
Permissions
At the instance level, this feature requires membership of the bulkadmin fixed server role, or ADMINISTER BULK OPERATIONS
permissions.
For the database level, this feature requires ADMINISTER DATABASE BULK OPERATIONS
permissions.
Accessing Azure Blob Storage requires read-write access.
Import a JSON document into a single column
OPENROWSET(BULK)
is a table-valued function that can read data from any file on the local drive or network, if SQL Server has read access to that location. It returns a table with a single column that contains the contents of the file. There are various options that you can use with the OPENROWSET(BULK)
function, such as separators. But in the simplest case, you can just load the entire contents of a file as a text value. (This single large value is known as a single character large object, or SINGLE_CLOB.)
Here's an example of the OPENROWSET(BULK)
function that reads the contents of a JSON file and returns it to the user as a single value:
SELECT BulkColumn
FROM OPENROWSET(BULK 'C:\JSON\Books\book.json', SINGLE_CLOB) as j;
OPENJSON(BULK)
reads the content of the file and returns it in BulkColumn
.
You can also load the contents of the file into a local variable or into a table, as shown in the following example:
-- Load file contents into a variable
DECLARE @json NVARCHAR(MAX);
SELECT @json = BulkColumn
FROM OPENROWSET(BULK 'C:\JSON\Books\book.json', SINGLE_CLOB) as j
-- Load file contents into a table
SELECT BulkColumn
INTO #temp
FROM OPENROWSET(BULK 'C:\JSON\Books\book.json', SINGLE_CLOB) as j
After loading the contents of the JSON file, you can save the JSON text in a table.
Import JSON documents from Azure File Storage
You can also use OPENROWSET(BULK)
as described previously to read JSON files from other file locations that SQL Server can access. For example, Azure File Storage supports the SMB protocol. As a result you can map a local virtual drive to the Azure File storage share using the following procedure:
Create a file storage account (for example,
mystorage
), a file share (for example,sharejson
), and a folder in Azure File Storage by using the Azure portal or Azure PowerShell.Upload some JSON files to the file storage share.
Create an outbound firewall rule in Windows Firewall on your computer that allows port 445. Your Internet service provider might block this port. If you get a DNS error (error 53) in the following step, then port 445 isn't open, or your ISP is blocking it.
Mount the Azure File Storage share as a local drive (for example
T:
).Here's the command syntax:
net use [drive letter] \\[storage name].file.core.windows.net\[share name] /u:[storage account name] [storage account access key]
Here's an example that assigns local drive letter
T:
to the Azure File Storage share:net use t: \\mystorage.file.core.windows.net\sharejson /u:myaccount hb5qy6eXLqIdBj0LvGMHdrTiygkjhHDvWjUZg3Gu7bubKLg==
You can find the storage account key and the primary or secondary storage account access key in the Keys section of Settings in the Azure portal.
Now you can access your JSON files from the Azure File Storage share by using the mapped drive, as shown in the following example:
SELECT book.* FROM OPENROWSET(BULK N't:\books\books.json', SINGLE_CLOB) AS json CROSS APPLY OPENJSON(BulkColumn) WITH ( id NVARCHAR(100), name NVARCHAR(100), price FLOAT, pages_i INT, author NVARCHAR(100) ) AS book
For more info about Azure File Storage, see File storage.
Import JSON documents from Azure Blob Storage
Applies to: SQL Server 2017 (14.x) and later versions, and Azure SQL
You can load files directly into Azure SQL Database from Azure Blob Storage with the T-SQL BULK INSERT command or the OPENROWSET
function.
First, create an external data source, as shown in the following example.
CREATE EXTERNAL DATA SOURCE MyAzureBlobStorage
WITH (
TYPE = BLOB_STORAGE,
LOCATION = 'https://myazureblobstorage.blob.core.windows.net',
CREDENTIAL = MyAzureBlobStorageCredential
);
Next, run a BULK INSERT command with the DATA_SOURCE option.
BULK INSERT Product
FROM 'data/product.dat'
WITH ( DATA_SOURCE = 'MyAzureBlobStorage');
Parse JSON documents into rows and columns
Instead of reading an entire JSON file as a single value, you might want to parse it and return the books in the file and their properties in rows and columns.
Example 1
In the simplest example, you can just load the entire list from the file.
SELECT value
FROM OPENROWSET(BULK 'C:\JSON\Books\books.json', SINGLE_CLOB) AS j
CROSS APPLY OPENJSON(BulkColumn);
The preceding OPENROWSET
reads a single text value from the file. OPENROWSET
returns the value as a BulkColumn, and passes BulkColumn to the OPENJSON
function. OPENJSON
iterates through the array of JSON objects in the BulkColumn array, and returns one book in each row. Each row is formatted as JSON, shown next.
{"id":"978-0641723445", "cat":["book","hardcover"], "name":"The Lightning Thief", ... }
{"id":"978-1423103349", "cat":["book","paperback"], "name":"The Sea of Monsters", ... }
{"id":"978-1857995879", "cat":["book","paperback"], "name":"Sophie's World : The Greek", ... }
{"id":"978-1933988177", "cat":["book","paperback"], "name":"Lucene in Action, Second", ... }
Example 2
The OPENJSON
function can parse the JSON content and transform it into a table or a result set. The following example loads the content, parses the loaded JSON, and returns the five fields as columns:
SELECT book.*
FROM OPENROWSET(BULK 'C:\JSON\Books\books.json', SINGLE_CLOB) AS j
CROSS APPLY OPENJSON(BulkColumn) WITH (
id NVARCHAR(100),
name NVARCHAR(100),
price FLOAT,
pages_i INT,
author NVARCHAR(100)
) AS book;
In this example, OPENROWSET(BULK)
reads the content of the file and passes that content to the OPENJSON
function with a defined schema for the output. OPENJSON
matches properties in the JSON objects by using column names. For example, the price
property is returned as a price
column and converted to the float data type. Here are the results:
Id | Name | price | pages_i | Author |
---|---|---|---|---|
978-0641723445 | The Lightning Thief | 12.5 | 384 | Rick Riordan |
978-1423103349 | The Sea of Monsters | 6.49 | 304 | Rick Riordan |
978-1857995879 | Sophie's World : The Greek Philosophers | 3.07 | 64 | Jostein Gaarder |
978-1933988177 | Lucene in Action, Second Edition | 30.5 | 475 | Michael McCandless |
Now you can return this table to the user, or load the data into another table.
Related content
Tilbakemeldinger
https://aka.ms/ContentUserFeedback.
Kommer snart: Gjennom 2024 faser vi ut GitHub Issues som tilbakemeldingsmekanisme for innhold, og erstatter det med et nytt system for tilbakemeldinger. Hvis du vil ha mer informasjon, kan du se:Send inn og vis tilbakemelding for