Well, that's kind of the point of the Preservation Hold Library in the first place - to store files for compliance purposes. If you need to remove some of the items stored therein, remove the matching holds - the system will clean up the corresponding items in the PHL.
Did you check for any holds affecting the items? Do make sure to include both Retention policies and eDiscovery holds in your checks.