How to access Azure Managed Instance for Apache Cassandra from Azure Data Factory?

Question

How to access Azure Managed Instance for Apache Cassandra from Azure Data Factory?

Boothalingham, Saradha 20

I'm trying to access Azure managed Instance for Apache Cassandra from ADF. We have 3 private Cassandra nodes in the data center. I couldn't find any supporting document on the internet. Can someone help me with this?

Boothalingham, Saradha 20 Reputation points

2023-09-14T05:55:25.8533333+00:00

Hi @Anonymous

Thank you for the prompt response. I will attempt to connect using the SHIR method and will share the outcomes.
kekiran-MSFT 391 Reputation points Microsoft Employee Moderator

2023-09-18T21:57:38.35+00:00

Hi @Boothalingham, Saradha

Have you had the opportunity to follow the suggested steps and, if so, could you please share the outcome with us and if that worked out or not?
kekiran-MSFT 391 Reputation points Microsoft Employee Moderator

2023-09-20T16:10:18.3+00:00

Hi @Boothalingham, Saradha

Just checking if there's any progress or updates?

--please don't forget to close up the thread here by marking answer if the reply is helpful--

1 answer

Your answer

Boothalingham, Saradha 20 Reputation points

2023-09-14T05:55:25.8533333+00:00

Hi @Anonymous

Thank you for the prompt response. I will attempt to connect using the SHIR method and will share the outcomes.
kekiran-MSFT 391 Reputation points Microsoft Employee Moderator

2023-09-18T21:57:38.35+00:00

Hi @Boothalingham, Saradha

Have you had the opportunity to follow the suggested steps and, if so, could you please share the outcome with us and if that worked out or not?
kekiran-MSFT 391 Reputation points Microsoft Employee Moderator

2023-09-20T16:10:18.3+00:00

Hi @Boothalingham, Saradha

Just checking if there's any progress or updates?

--please don't forget to close up the thread here by marking answer if the reply is helpful--

Answer 1

kekiran-MSFT 391 Microsoft Employee Moderator

Hi @Boothalingham, Saradha

Welcome to Microsoft Q&A platform and thank you for your query.

At present, we do not have a dedicated connector for Azure Managed Instance for Apache Cassandra in Azure Data Factory.

Having said that you can submit feedback here for the direct connector to Managed instance for Apache Cassandra: - https://feedback.azure.com/d365community/forum/1219ec2d-6c26-ec11-b6e6-000d3a4f032c

and share the link with us as well so that we can communicate with the Product group team.

As I dived deeper into this, I came across a potential action plan that you can consider implementing. It would be great if you could also give it a try and share your results with us.

Can you use existing Cassandra connector to connect to the Azure Managed instance for Apache Cassandra. As your Managed Instance for Apache Cassandra resides within a Virtual Network (Vnet), you have to create a Self-Hosted Integration Runtime (SHIR) to establish a connection to it. You can either host SHIR within the same Vnet as the Cassandra instance or ensure that the Vnet of Cassandra and SHIR are configured to communicate with each other (Vnet Peering).

Cassandra_Connector

You also need to make your Azure Managed instance for Apache Cassandra is on Supported version:

connectorsupport

Rest of the configuration will be similar to what you do for the other any other Cassandra Apache server: - https://learn.microsoft.com/en-us/azure/data-factory/connector-cassandra?tabs=data-factory

Boothalingham, Saradha 20 Reputation points

2023-10-24T12:06:08.84+00:00
Hi @Anonymous

Apologies for delayed response.
I followed the steps you mentioned to connect to Azure Managed Cassandra Instance.

Used the existing Apache Cassandra connector.

Created a SHIR on the same VNet as Azure Managed Cassandra Instance.

Azure managed ApacheCassandra instance version 4.0.
But I'm getting this error:
ERROR [HY000] [Microsoft][CassandraODBC] (10) Error while executing a query in Cassandra: [16777226] : No hosts available for the control connection

ERROR [HY000] [Microsoft][CassandraODBC] (10) Error while executing a query in Cassandra: [16777226] : No hosts available for the control connection

Could you please help me in fixing this?
kekiran-MSFT 391 Reputation points Microsoft Employee Moderator

2023-10-25T21:01:27.4433333+00:00

Hi @Boothalingham, Saradha

Thank you for your feedback. I understand that there may have been some confusion regarding the compatibility of the Cassandra connector. As mentioned in the document and in my previous response, the Cassandra connector is designed to support versions 2.x and 3.x.

Unfortunately, version 4.0, which you are currently using, is not supported by this connector. Please try the support version, also it will be great if you can submit a feedback direct connector to Managed instance for Apache Cassandra using the link which is mentioned in the answer above.
Boothalingham, Saradha 20 Reputation points

2023-10-26T05:54:43.9566667+00:00

Hi @Anonymous

Thank you for the prompt response.
Developing a new dedicated connector may take time right? This is a critical aspect of our data architecture and needs immediate focus. Any alternative methods for extracting data from Azure Managed Cassandra and transferring it to Snowflake?
kekiran-MSFT 391 Reputation points Microsoft Employee Moderator

2023-10-30T16:40:44.92+00:00

Hi @Boothalingham, Saradha,

Thanks for your reply and I can understand your concern. Unfortunately, I don't see any other way around on this and we might have to wait for the connector. Yes it can take time however I can also submit our discussion as a feedback to the product group .

Share via

How to access Azure Managed Instance for Apache Cassandra from Azure Data Factory?

1 answer

Your answer