On demand instance creation of custom VM images

nsftDDx 1 Reputation point
2021-12-09T11:19:08.733+00:00

Hello all,

I have 3 VM's set up in Azure environment. File Server and DB Server and Calcualtion Server (Windows 10 Pro). Calcualtion server processes job received on File Server, generates the ouput and stores it to DB and File servers. Calcaulation server has all the necessary tools pre-configured in it.

In current system, the jobs get processed in queue.

Now I would like to instantiate the calcuation server on demand i.e. if 10 jobs are submitted, 10 VM's of Calcaultion server will start and process 1 job each simultaneously, generate ouput and shutdown itself.

I am novice here and any help or suggestions/guidance will be of great help.

I hope I am clear with the requirement.

Thanks in advance.
Best regards,
DD

Azure Container Instances
Azure Container Instances
An Azure service that provides customers with a serverless container experience.
676 questions
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
322 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Ravi Kanth Koppala 3,231 Reputation points Microsoft Employee
    2021-12-09T16:02:33.55+00:00

    @nsftDDx ,
    Azure Automation delivers cloud-based automation, operating system updates, and configuration service that supports consistent management across your Azure and non-Azure environments. It includes process automation, configuration management, update management, shared capabilities, and heterogeneous features. I see multiple options to achieve it. I would recommend you to put some thought into testing whether the approach works with your application architecture or with your organization's cloud policies.

    1. Logicapps: If we migrate your process execution code into logic apps, you can eradicate the VM. This is more flexible and can work for one job or multiple concurrent job execution, but through this option, you might have to rearchitect your job.
    2. Power Automate (flow) is new and robust. Recently, the flow has VM connectors through which we can perform VM operations. Through PowerShell & flow, you can execute the job. If you want a separate VM for each job execution then you can have a VMs pool (for example, 5 VM). Check if a VM is in a stop state, then start it, execute the program/job, and shut it down.
    3. Leverate Azure Runbooks automation - For more information, you can go through the article - https://learn.microsoft.com/en-us/azure/automation/start-runbooks

    I hope I answered your question.

    0 comments No comments