Erik Fraser, Apologies for the delayed response from over the weekend.
What is the exact error message that you receive installing the plugin? Are you leveraging App Service Windows or Linux?
PHP 8.x images are pre-built with imagick extension. It will pull the latest available version of imagick when a new tag is available following the App Service OS and runtime patching times.
Just to highlight, ImageMagick best practices strongly encourages you to configure a security policy that suits your local environment.
If you desire to modify these policies on Azure App Service Linux, the best option to accomplish this will be to use a startup script.
Here is an example for removing policies for ghostscript:
#!/bin/bash
#Removing ghostscript policies
sed -i '/disable ghostscript format types/,+6d' /etc/ImageMagick-6/policy.xml
#Update Ghostscript
apt-get update && apt-get install -y ghostscript
service nginx reload
And then update the startup script location from Azure Portal: