Integrating HDInsight Zeppelin Notebook in Azure Data Factory

Vikranth-2626 140 Reputation points
2024-02-01T02:44:26.8533333+00:00

What's the optimal approach for invoking a Zeppelin notebook from an HDInsight cluster within Azure Data Factory? I have a Zeppelin notebook on HDInsight, and I want to initiate it through Azure Data Factory. Additionally, what's the most efficient method for crafting Spark code and triggering it within Data Factory? I'm seeking guidance on seamlessly integrating these elements for effective data processing.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions
{count} votes

Accepted answer
  1. PRADEEPCHEEKATLA-MSFT 85,746 Reputation points Microsoft Employee
    2024-02-01T06:18:53.37+00:00

    @Vikranth - Thanks for the question and using MS Q&A platform.

    Currently, you cannot run HDInsight Zeppelin Notebook in Azure Data Factory.

    These are the supported HDInsight activities in Azure Data Factory:

    User's image

    For more details, refer to Transform data in Azure Data Factory and Azure Synapse Analytics.

    Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.


0 additional answers

Sort by: Most helpful