import sql query data as a json document to azure data lake storage

Raj D 586 Reputation points
2020-07-17T18:17:00.763+00:00

Hi, I am new to Azure Data Lake Storage. I am trying to import data from different vendor applications where data is hosted on a SQL Database in Azure virtual machines, trying to convert table data to json document and store it in Azure Data Lake Storage. And, What options are available to automate this.

Could you please guide me in the right direction.

SELECT *
  FROM [dbo].[table]
     FOR JSON PATH

Thank you

SQL Server on Azure Virtual Machines
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,403 questions
{count} votes

Accepted answer
  1. Vaibhav Chaudhari 38,671 Reputation points
    2020-07-20T08:06:02.057+00:00

    You could think of using Azure data factory service to automate this. This service is used to orchestrate the ETL flow on Azure.

    Create ADF, create pipeline and drag and drop Copy activity. Configure the source (SQL table), target connection (Json in ADLS) and this pipeline can be scheduled to run. Use this for reference - tutorial-hybrid-copy-data-tool

    ----------

    If the response helped, do "Accept Answer" and upvote it -- Vaibhav

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful