Yes, it is safe to delete all files from that Cache folder.
The best option is to first disable Delivery Optimization to stop that Cache folder filling up.
Open the Settings App.
Go to Windows Update - Delivery Optimization and disable all options on that window for both upload and download.
This will not affect your PC receiving updates.