Share via

Invoking custom java code through Jar Application from Azure Data Factory

Imran Shahid 1 Reputation point
2021-12-20T06:39:46.77+00:00

Hi Everyone,

I am have been trying to invoke a Jar application code from Azure Data Factory and I am unable to make sense here that how we can deploy the custom Jar and use it in Azure Data Factory.

Following is the example I am trying to achieve from Azure Data Factory:

java helloworld.jar param1 param2 param3

I have tried calling some Powershell scripts as a practice through Azure Batch Service but I am not sure where I will deploy my custom jar and how can I invoke using the above command.

Also, Is there any other way to achieve it as well?

I would really appreciate the help here, as I have been looking into it for quite some time but things are still not clear enough.

Thanks.

Azure Data Lake Storage
Azure Data Lake Storage

An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.

Azure Batch
Azure Batch

An Azure service that provides cloud-scale job scheduling and compute management.

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.


1 answer

Sort by: Most helpful
  1. Imran Shahid 1 Reputation point
    2021-12-28T09:50:15.737+00:00

    hi @Saurabh Sharma ,

    Thanks for reaching me out, I think I have figured the ways we can call any Jar or Executeable from the data factory. There are three services i came to know as following:

    1. Batch Account
    2. Functions
    3. WebJobs

    In my case, Azure Functions are not the case because of the early timeouts and Azure Batch functions are not feasible too as we will have too less tasks to run on. Anyways, I have a new question now that I am trying to ask if we can call the Jar file from ADF available on any of VMs manually installed on EC2 instance.

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.