@Nonathon I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to "Accept " the answer.
Issue: Is it possible to remove the retention period from a blob after the policy that initially applied the retention has been deleted? I've established a new immutable retention policy for one day in the hope that it will overwrite the existing value, but I have reservations about its effectiveness.
Solution: It was discovered that although the retention policy at the container level was removed, the policy still remained at the individual blob level. By clicking on the three dots next to the specific blob and navigating to the access policy section, the policy was successfully deleted. Once the policy for the blob was removed, it became possible to delete both the blob itself and subsequently the entire storage account.
Please remember to "Accept Answer" if any answer/reply helped, so that others in the community facing similar issues can easily find the solution.