Hi Pastor Ed at the church,
- What is the exact error message you are receiving when you delete the folder?
- What is the exact error message you are receiving when you save a file on external hard drive?
- Have you installed McAfee on your computer?
Method 1: Removing the folder from library.
I suggest you to try safe mode and try removing the folder.
Refer:
Advanced startup options including safe mode
http://windows.microsoft.com/en-US/windows7/Advanced-startup-options-including-safe-mode
Method 2: If still the issue persists then I suggest you to try the below steps to fix the issue:
a. Open Windows Explorer.
b. Right-click on the corresponding library and choose Delete.
c. Click Yes when asked for confirmation.
Note: Deleting a library does not delete the contents of the included folders. However, you may need to re-add or include your folders manually, if needed.
Refer:
Include folders in a library:
http://windows.microsoft.com/en-US/windows7/Include-folders-in-a-library
d. Then, in the navigation pane of Windows Explorer, right-click on Libraries and click Restore default libraries.
e. This recreates the library that you just deleted.
f. This option will only restore the default libraries that came with Windows 7.

You may also refer:
Libraries: frequently asked questions
http://windows.microsoft.com/en-us/windows7/Libraries-frequently-asked-questions
Thanks and Regards:I. Suuresh Kumar - Microsoft Support. Visit our Microsoft Answers Feedback Forum and let us know what you think.