Hi everyone,
I'm looking for some solution design and ideas for a little side project site I'm working on. In brief, the way it works is, PHP will generate a .php file and that file contains instructions to run a python job. The python job should execute, gather the required data, and then return the results to PHP. Next, PHP will run a secondary task, which again requires the execution of a different python job once the data is provided to PHP, PHP will in turn display data to the front end/website, and the workflow is finished.
Now, I got some of this process working on a VM, but the proxy scripts takes 1-2 mins to run on my server, and I need to bring it down to 5 seconds or less. The way for me to bring it down is by having python re-configured to run it's processes via threading 50x. I can't do this locally on the VM server as it doesn't have the resources to run 50 threads simultaneously, so I' thinking about offloading this to a fast and cost efficient solution, ie Azure. If I can have PHP send the request to Azure for processing of the python job, then that may solve my problem and it really shouldn't cost much, especially if I'm billed according to time utilizing the platform (few seconds for each request).
I'm looking for some opinions and ideas, as I'm just trying to learn more about Azure. Can I use containers, logic apps, or functions, etc. If anyone has any suggestions, I can dig deeper on those features and topic.
Additional Note: The python job is not just a single .py file, it's a library which consists of python files, jsons, cfg, etc. Here is an example of what the files look like in one of the python jobs: https://github.com/mirhmousavi/Pois
Thanks!