@Grmacjon-MSFT @Dirk385
Microsoft have updated the Azure portal functionality since I posted my question to fix their mistake. In WebJobs if you have access restrictions specified for the Advanced Tool Site (SCM) the WebJob page will now have a warning of:
"Traffic to the SCM on your app is blocked. To ensure the success of web job commands, you must either set the default unmatched rule to 'Allow' or add an 'Allow' rule for your IP address in the Advanced Tool Site section of Access restrictions"
instead of:
"The scm site for your app is blocked. In order to use webjobs you must allow traffic to the advanced tool site."
The Logs/Run/Delete/Add buttons were previously being disabled by the change a month ago but now they are all enabled. If you haven't added an IP access restriction to the IP address your access the browser from then the Run and Delete buttons work fine but Logs doesn't (because it redirects to the SCM site, which since you've blocked access to won't load). "Add" looks like it has worked but never completes in the background.
So it's good to see Microsoft have addressed the mistake - I still think the part about "To ensure the success of web job commands" is misleading and may result in users thinking they need to allow access for the WebJobs to run - the message I think is just referring to the Azure portal invoking commands to the WebJobs, specifically Log and Add.
So to be clear, in answer to "What is the minimum access needed in Networking > Access Restrictions > Advanced Tool Site to allow the Azure Portal access to manage WebJobs?" - the answer is now you don't need to allow any access to the Advanced Tool Site unless you want to view the Logs or Add a new WebJob via the portal - if you want to do those things via the portal the minimum access you'll need is to add an "Allow" rule for your IP address and deny all other traffic. You can check your IP address via a site like: https://whatismyipaddress.com/