Hello @Luuk van Vliet ,
Thanks for the ask and using the forum .
I think in your pipeline you want to execute some Python script and if thats the intend I think you can use Azure databricks . You can create a cluster and install the packages and have a notebook where you can have the python code . You can initiliaze the cluster from ADF . I have tried this and it worked for me .
Going back to the point which you made , i think working with Azure batch should also click .
Thanks
Himanshu