I did a test in my environemnt and I could see the button download all for these attachments
And I found a thread here discussed the same question: How to download all attachments from one e-mail in OWA
Please Note: Since the web site is not hosted by Microsoft, the link may change without notice. Microsoft does not guarantee the accuracy of this information.
If an Answer is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.