I can reproduce this issue in my SharePoint Online "Embed" web part.
In my opinion, it's by design, there is no setting to get rid of the box overlay.
If an Answer is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.