Integrating HDInsight Zeppelin Notebook in Azure Data Factory

Question

What's the optimal approach for invoking a Zeppelin notebook from an HDInsight cluster within Azure Data Factory? I have a Zeppelin notebook on HDInsight, and I want to initiate it through Azure Data Factory. Additionally, what's the most efficient method for crafting Spark code and triggering it within Data Factory? I'm seeking guidance on seamlessly integrating these elements for effective data processing.

Answer 1

@Vikranth - Thanks for the question and using MS Q&A platform.

Currently, you cannot run HDInsight Zeppelin Notebook in Azure Data Factory.

These are the supported HDInsight activities in Azure Data Factory:

For more details, refer to Transform data in Azure Data Factory and Azure Synapse Analytics.

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.