ADF write json to elasticsearch

Eran Hadad 1 Reputation point
2022-11-24T13:45:04.587+00:00

Hi,
I'm using ADF to run a procedure in SQL Server that generates data into a table.
As next step, I want to insert the table data to elasticsearch.
I have no idea how to go about.
I moved the data to Azure storage account as JSON and tried inserting this JSON to Elastic but with no success.
Any ideas will be much appreciated

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,640 questions
{count} votes

1 answer

Sort by: Most helpful
  1. HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
    2022-11-28T21:26:27.63+00:00

    Hello @Eran Hadad ,
    Thanks for the question and using MS Q&A platform.
    As we understand the ask here is how to SQL data to elastic search , please do let us know if its not accurate.
    The elastic search once have the data , also needs to index the data so that the seeach can be done . Its true that that ADF does lots of ingesation oif different kind , but I think you need ingest data using the elastic worksplace only as it will also index the data for future search .
    A quick search did gave this and I think you can start from here .

    http://www.bietltools.com/how-to-get-data-from-sql-server-data-to-elasticsearch-using-logstash/

    Please do let me if you have any queries.
    Thanks
    Himanshu


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators