The short answer is No.
All default permissions are categorized as list permissions, site permissions, and personal permissions, the permissions that can update columns are included in the list permissions, and there is no special permissions depended on columns.
In other words, when you give users permission to add or delete columns in the list, obviously they can also delete the entire document library.
If an Answer is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.