Share via

import sql query data as a json document to azure data lake storage

Raj D 616 Reputation points
2020-07-17T18:17:00.763+00:00

Hi, I am new to Azure Data Lake Storage. I am trying to import data from different vendor applications where data is hosted on a SQL Database in Azure virtual machines, trying to convert table data to json document and store it in Azure Data Lake Storage. And, What options are available to automate this.

Could you please guide me in the right direction.

SELECT *
  FROM [dbo].[table]
     FOR JSON PATH

Thank you

SQL Server on Azure Virtual Machines
Azure Data Lake Storage
Azure Data Lake Storage

An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.


Answer accepted by question author

Vaibhav Chaudhari 39,011 Reputation points Volunteer Moderator
2020-07-20T08:06:02.057+00:00

You could think of using Azure data factory service to automate this. This service is used to orchestrate the ETL flow on Azure.

Create ADF, create pipeline and drag and drop Copy activity. Configure the source (SQL table), target connection (Json in ADLS) and this pipeline can be scheduled to run. Use this for reference - tutorial-hybrid-copy-data-tool

----------

If the response helped, do "Accept Answer" and upvote it -- Vaibhav

Was this answer helpful?

1 person found this answer helpful.
0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.