I needed to output some data in a custom CSV format, and quickly discovered that it couldn't be done directly in data factory. After a fair amount of trial and error, I have set up an Azure Function to take a json file, generated with a scheduled trigger in data factory, and convert it to the desired format.
The function and the process all seem to work fine, assuming I am actively viewing the function.
If left unattended, overnight for example, the input JSON file is generated, but the function isn't triggered by the blob creation and it therefore never processes the file.
What is annoying though is that if I simply navigate to the function app, it suddenly 'wakes up', detects the files, and executes as intended.
Does anyone happen to know why this is the case, and what can be done to make it stay awake?