Elastic search to Azure Synapse

Question

Elastic search to Azure Synapse

Kumar, Amit 41

Hi

I want to trnasfer data from on premises elastic search to Azure Synapse .
Can you please suggest how i can implement the same

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2022-11-07T05:45:16.077+00:00
Hello @Kumar, Amit ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.
Kumar, Amit 41 Reputation points

2022-11-07T06:14:44.697+00:00

Hi Pradeep

Thanks for your help. Cdata connector is helpful but still it's third paty connector and we cannot rely on this.
Can we request azure team to look into feasibilty of elastic search connecor and please consider it in coming future releases .

Regards
Amit
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2022-11-07T06:29:08.207+00:00
Hello @Kumar, Amit ,

Unfortunately, there is no connector available in Azure Data Fatory/Synapse Analytics.

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

Hope this helps.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2022-11-10T06:39:55.89+00:00
Hello @Kumar, Amit ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

---------

Please don't forget to click on or upvote button whenever the information provided helps you.

1 answer

Your answer

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2022-11-07T05:45:16.077+00:00

Hello @Kumar, Amit ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.
Kumar, Amit 41 Reputation points

2022-11-07T06:14:44.697+00:00

Hi Pradeep

Thanks for your help. Cdata connector is helpful but still it's third paty connector and we cannot rely on this.
Can we request azure team to look into feasibilty of elastic search connecor and please consider it in coming future releases .

Regards
Amit
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2022-11-07T06:29:08.207+00:00

Hello @Kumar, Amit ,

Unfortunately, there is no connector available in Azure Data Fatory/Synapse Analytics.

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

Hope this helps.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2022-11-10T06:39:55.89+00:00

Hello @Kumar, Amit ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

---------

Please don't forget to click on or upvote button whenever the information provided helps you.

Answer 1

Hello @Kumar, Amit ,

Thanks for the question and using MS Q&A platform.

Before we go into the answer for which you are looking let understand the integration runtimes available in Azure Data Factory/ Synapse Analytics.

Azure Data Factory offers three types of Integration Runtime (IR), and you should choose the type that best serve the data integration capabilities and network environment needs you're looking for. These three types are:

Azure – Helps to connect data sources in Azure Cloud.
Self-hosted – Helps to connect data sources from on-premise.
Azure-SSIS – Helps to lift and shift existing SSIS workload in Azure

Note: Synapse pipelines currently only support Azure or self-hosted integration runtimes.

For more details, refer to Integration runtime in Azure Data Factory.

When you move data between on-premises and the cloud, the activity uses a self-hosted integration runtime to transfer the data between an on-premises data source and the cloud.

Here is a high-level summary of the data-flow steps for copying with a self-hosted IR:

For more details, refer to Create and configure a self-hosted integration runtime

In case, if the Self-hosted IR doesn't work for your scenario, you need to depend on the third-party services like CDATA.

For more details, refer to Moving from on-prem to Elastic Cloud (Elasticsearch managed service) on Microsoft Azure and SO thread How can I replicate Elasticsearch data to azure synapse? adressing similar issue.

Hope this will help. Please let us know if any further queries.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
Want a reminder to come back and check responses? Here is how to subscribe to a notification
If you are interested in joining the VM program and help shape the future of Q&A: Here is jhow you can be part of Q&A Volunteer Moderators

Share via

Elastic search to Azure Synapse

1 answer

Your answer