question

PritiBhangale-2614 avatar image
0 Votes"
PritiBhangale-2614 asked HimanshuSinha-MSFT commented

Extract data from SQL Database table and insert into Elasticsearch Particular index

Hi Team,

I have SQL Database, from that i have to retrieve some tables data using query and insert resulted data in elasticsearch particular index. Please suggest how can it possible through Azure Data Factory ?

azure-data-factory
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @PritiBhangale-2614 ,


Just wanted to follow up and check if the below suggestion helped you resolve the issue . Also if case if you have a better work around or resolution please do share that with the community as it will help other community members .


Thanks & stay safe


Himanshu


0 Votes 0 ·

Hello @PritiBhangale-2614 ,


We are just checking back again if the issue is resolved .In case if you have a resolution we request you to share that with the community .


Thanks Himanshu


0 Votes 0 ·

1 Answer

HimanshuSinhamfst-5269 avatar image
0 Votes"
HimanshuSinhamfst-5269 answered

Hello @PritiBhangale-2614

Thanks for the using the new forum .

It appears that you have the data in SQL and you are plannig to write that to ES using the API . The copy activity cannot be used as the in our case the sink will be http or REST and they are not supported as sink but only as source .

Please read on this here :https://docs.microsoft.com/en-us/azure/data-factory/copy-activity-overview

You didn't mentioned where is ES instance is hosted , if its on the public internet you can use lookup activity and web acticvity , if its on the local network , web activity cannot be used .

https://docs.microsoft.com/en-us/azure/data-factory/control-flow-web-activity

Please let me know if you have any further queries .



Thanks Himanshu

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.