Share via

Connecting Kafka from ADF

Ashutosh Mitkari 5 Reputation points
2024-03-18T06:37:12.9366667+00:00

Hi

I wanted to build a ADF Pipeline to ingest data from Kafka platform, Let me know if there is a link which can can elaborate the ways to connect the Kafka from ADF and ingest / copy the data in to target zone

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Smaran Thoomu 12,620 Reputation points Microsoft Vendor
    2024-03-18T08:12:08.8433333+00:00

    Hi @Ashutosh Mitkari

    Thank you for posting query in Microsoft Q&A Platform.

    Azure Data Factory doesn't come with a direct way to connect to Kafka. However, there's a workaround to bring data from Kafka into Azure Data Explorer (ADX). ADX is a service designed for quickly exploring and analysing log and telemetry data.

    If you're interested in getting data from Kafka into Azure Data Explorer (ADX), you can make it happen. The documentation offers a detailed, step-by-step explanation of how to achieve this using the Kafka Connect framework.

    Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

    Hope this helps. Do let us know if you any further queries.

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.